2020-10-05T11:42:41.678 INFO:root:teuthology version: 1.0.0-75888fc 2020-10-05T11:42:41.680 DEBUG:teuthology.run:Teuthology command: teuthology --description rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} --archive /home/teuthworker/archive/yuvalif-2020-10-05_09:58:27-rgw-wip-yuval-static-analysis-distro-basic-smithi/5498204 --lock --owner scheduled_yuvalif@teuthology --block --name yuvalif-2020-10-05_09:58:27-rgw-wip-yuval-static-analysis-distro-basic-smithi --verbose -- /tmp/teuthology-worker.li3myv9k.tmp 2020-10-05T11:42:41.715 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-10-05T11:42:41.776 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuvalif-2020-10-05_09:58:27-rgw-wip-yuval-static-analysis-distro-basic-smithi/5498204 branch: wip-yuval-static-analysis description: rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} email: null first_in_suite: false job_id: '5498204' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuvalif-2020-10-05_09:58:27-rgw-wip-yuval-static-analysis-distro-basic-smithi nuke-on-error: true os_type: ubuntu overrides: admin_socket: branch: wip-yuval-static-analysis ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= rgw curl low speed time: 300 rgw data log num shards: 4 rgw md log max shards: 4 rgw sync log trim interval: 0 rgw sync obj etag verify: true setgroup: ceph setuser: ceph global: osd heartbeat grace: 40 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd fast shutdown: false rocksdb delete range threshold: 0 osd.0: osd_max_omap_entries_per_request: 10 osd.1: osd_max_omap_entries_per_request: 1000 osd.2: osd_max_omap_entries_per_request: 10000 log-ignorelist: - \(PG_AVAILABILITY\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b726425d5bff271f4fe469ee94a9b80f7cad00ba wait-for-scrub: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: b726425d5bff271f4fe469ee94a9b80f7cad00ba rgw: compression type: random frontend: beast rgw-multisite: realm: is default: true name: test-realm zonegroups: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zonegroup zones: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zone1 - endpoints: - c2.client.0 is_default: true name: test-zone2 - endpoints: - c1.client.1 name: test-zone3 - endpoints: - c2.client.1 is_pubsub: true name: test-zone4 workunit: branch: wip-yuval-static-analysis sha1: b726425d5bff271f4fe469ee94a9b80f7cad00ba owner: scheduled_yuvalif@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - c1.mon.a - c1.mgr.x - c1.osd.0 - c1.osd.1 - c1.osd.2 - c1.client.0 - c1.client.1 - - c2.mon.a - c2.mgr.x - c2.osd.0 - c2.osd.1 - c2.osd.2 - c2.client.0 - c2.client.1 sha1: b726425d5bff271f4fe469ee94a9b80f7cad00ba sleep_before_teardown: 0 suite: rgw suite_branch: wip-yuval-static-analysis suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-static-analysis/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: b726425d5bff271f4fe469ee94a9b80f7cad00ba tasks: - install: null - ceph: cluster: c1 - ceph: cluster: c2 - rgw: c1.client.0: port: 8000 c1.client.1: port: 8001 c2.client.0: port: 8000 c2.client.1: port: 8001 - rgw-multisite: null - rgw-multisite-tests: config: reconfigure_delay: 60 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.24691 2020-10-05T11:42:41.777 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-static-analysis/qa; will attempt to use it 2020-10-05T11:42:41.778 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-static-analysis/qa/tasks 2020-10-05T11:42:41.778 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-10-05T11:42:41.780 INFO:teuthology.task.internal:Checking packages... 2020-10-05T11:42:41.800 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'b726425d5bff271f4fe469ee94a9b80f7cad00ba' 2020-10-05T11:42:41.800 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-10-05T11:42:41.801 INFO:teuthology.packaging:ref: None 2020-10-05T11:42:41.801 INFO:teuthology.packaging:tag: None 2020-10-05T11:42:41.801 INFO:teuthology.packaging:branch: wip-yuval-static-analysis 2020-10-05T11:42:41.802 INFO:teuthology.packaging:sha1: b726425d5bff271f4fe469ee94a9b80f7cad00ba 2020-10-05T11:42:41.802 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-yuval-static-analysis 2020-10-05T11:42:41.967 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-6145-gb726425d-1bionic 2020-10-05T11:42:41.967 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-10-05T11:42:41.974 INFO:teuthology.task.internal:no buildpackages task found 2020-10-05T11:42:41.975 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-10-05T11:42:42.002 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-10-05T11:42:42.004 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-10-05T11:42:42.053 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-10-05T11:42:52.075 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-10-05T11:43:02.091 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-10-05T11:43:12.106 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-10-05T11:43:22.123 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-10-05T11:43:32.140 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-10-05T11:43:42.154 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-10-05T11:43:52.165 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-10-05T11:44:02.183 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-10-05T11:44:12.199 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-10-05T11:44:22.222 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-10-05T11:44:32.238 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_yuvalif@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/yuvalif-2020-10-05_09:58:27-rgw-wip-yuval-static-analysis-distro-basic-smithi/5498204'} 2020-10-05T11:44:32.257 DEBUG:teuthology.lock.ops:locked ubuntu@smithi158.front.sepia.ceph.com, ubuntu@smithi081.front.sepia.ceph.com 2020-10-05T11:44:32.320 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa87a284158>, signals=[15]) 2020-10-05T11:44:32.539 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of ubuntu 18.04 2020-10-05T11:44:32.542 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of ubuntu 18.04 2020-10-05T11:44:32.892 INFO:teuthology.orchestra.console:Power off smithi081 2020-10-05T11:44:32.893 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-10-05T11:44:32.909 INFO:teuthology.orchestra.console:Power off smithi158 2020-10-05T11:44:32.910 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-10-05T11:44:32.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-05T11:44:32.931 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-05T11:44:36.946 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-05T11:44:36.961 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-05T11:44:41.062 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-05T11:44:41.074 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-05T11:44:45.178 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-05T11:44:45.190 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-05T11:44:45.392 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2020-10-05T11:44:45.404 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2020-10-05T11:44:45.494 INFO:teuthology.orchestra.console:Power on smithi081 2020-10-05T11:44:45.494 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-10-05T11:44:45.505 INFO:teuthology.orchestra.console:Power on smithi158 2020-10-05T11:44:45.506 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-10-05T11:44:45.517 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-05T11:44:45.529 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-05T11:44:49.542 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-05T11:44:49.553 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-05T11:44:49.755 INFO:teuthology.orchestra.console:Power on for smithi081 completed 2020-10-05T11:44:49.763 INFO:teuthology.orchestra.console:Power on for smithi158 completed 2020-10-05T11:44:49.857 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2020-10-05T11:44:49.864 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2020-10-05T11:47:51.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:47:51.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:47:51.636 ERROR:teuthology.orchestra.connection:Error connecting to smithi158.front.sepia.ceph.com Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/connection.py", line 108, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 446, in connect passphrase, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 764, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 740, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 1580, in auth_publickey return self.auth_handler.wait_for_response(my_event) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/auth_handler.py", line 250, in wait_for_response raise e paramiko.ssh_exception.AuthenticationException: Authentication failed. 2020-10-05T11:48:00.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:48:09.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:48:18.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:48:27.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:48:36.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:48:45.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:48:58.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:49:07.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:49:10.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:49:19.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:49:28.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:49:37.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:49:37.999 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-10-05T11:49:44.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:49:44.183 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-10-05T11:49:44.185 INFO:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-10-05T11:49:44.543 INFO:teuthology.provision.fog.smithi081:Node is ready 2020-10-05T11:49:44.543 INFO:teuthology.orchestra.run.smithi081:> hostname 2020-10-05T11:49:44.589 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2020-10-05T11:49:44.589 INFO:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts 2020-10-05T11:49:44.637 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2020-10-05T11:49:44.638 INFO:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2020-10-05T11:49:44.700 INFO:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts 2020-10-05T11:49:44.758 INFO:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2020-10-05T11:49:44.814 INFO:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname 2020-10-05T11:49:44.871 INFO:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2020-10-05T11:49:44.925 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2020-10-05T11:49:44.926 DEBUG:teuthology.parallel:result is None 2020-10-05T11:50:13.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:50:13.810 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-10-05T11:50:13.810 INFO:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-10-05T11:50:14.171 INFO:teuthology.provision.fog.smithi158:Node is ready 2020-10-05T11:50:14.171 INFO:teuthology.orchestra.run.smithi158:> hostname 2020-10-05T11:50:14.216 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2020-10-05T11:50:14.217 INFO:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts 2020-10-05T11:50:14.265 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2020-10-05T11:50:14.265 INFO:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2020-10-05T11:50:14.327 INFO:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts 2020-10-05T11:50:14.383 INFO:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2020-10-05T11:50:14.436 INFO:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname 2020-10-05T11:50:14.493 INFO:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2020-10-05T11:50:14.549 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2020-10-05T11:50:14.550 DEBUG:teuthology.parallel:result is None 2020-10-05T11:50:14.703 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2020-10-05T11:50:14.703 INFO:teuthology.lock.ops:New key found. Updating... 2020-10-05T11:50:14.719 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2020-10-05T11:50:14.719 INFO:teuthology.lock.ops:New key found. Updating... 2020-10-05T11:50:14.733 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2020-10-05T11:50:14.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-10-05T11:50:14.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:50:14.802 INFO:teuthology.orchestra.run.smithi158:> true 2020-10-05T11:50:15.043 INFO:teuthology.orchestra.run.smithi158:> uname -m 2020-10-05T11:50:15.089 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2020-10-05T11:50:15.089 INFO:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2020-10-05T11:50:15.137 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Ubuntu" 2020-10-05T11:50:15.137 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-10-05T11:50:15.137 INFO:teuthology.orchestra.run.smithi158.stdout:ID=ubuntu 2020-10-05T11:50:15.137 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE=debian 2020-10-05T11:50:15.137 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-10-05T11:50:15.137 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="18.04" 2020-10-05T11:50:15.138 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.ubuntu.com/" 2020-10-05T11:50:15.138 INFO:teuthology.orchestra.run.smithi158.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-10-05T11:50:15.138 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-10-05T11:50:15.138 INFO:teuthology.orchestra.run.smithi158.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-10-05T11:50:15.138 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_CODENAME=bionic 2020-10-05T11:50:15.138 INFO:teuthology.orchestra.run.smithi158.stdout:UBUNTU_CODENAME=bionic 2020-10-05T11:50:15.139 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2020-10-05T11:50:15.156 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2020-10-05T11:50:15.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-10-05T11:50:15.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:50:15.233 INFO:teuthology.orchestra.run.smithi081:> true 2020-10-05T11:50:15.471 INFO:teuthology.orchestra.run.smithi081:> uname -m 2020-10-05T11:50:15.516 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2020-10-05T11:50:15.517 INFO:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2020-10-05T11:50:15.564 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2020-10-05T11:50:15.565 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-10-05T11:50:15.565 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2020-10-05T11:50:15.565 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2020-10-05T11:50:15.565 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-10-05T11:50:15.565 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="18.04" 2020-10-05T11:50:15.565 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2020-10-05T11:50:15.566 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-10-05T11:50:15.566 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-10-05T11:50:15.566 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-10-05T11:50:15.566 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=bionic 2020-10-05T11:50:15.566 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=bionic 2020-10-05T11:50:15.567 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2020-10-05T11:50:15.582 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-10-05T11:50:15.614 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi081.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSw/9O7CI4W2dWnjnOZxzsRsbd5XrpT8KDTWzX4fLmtu1iO0qqFnAZQiDLhrm7L0sKL1nhRx45Oz1JSRoBKv+31Ncpb3KzmaugaS4V2fQvgMaB3cy86EbX0CMYsyKVoHq600SgP0GRWoR8EUL+P4zycaGiLm5hPzH6swIFXNjqb5WmybLHwrw5vv3308PmVbOISaaA0ZknAt5LruOpH28au5Aa5Q8f6SWOOvv4IEVXv4ASV890FLAn6alJuGkx9kCIqqMqwVt65LcFuNnvFcvXpkHYygIOUlP3wuTdBZS8WLWEkBvrG2A4GufkHdGbcT54T9tv3d2EJl0cEy0qnraP smithi158.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDM+8gyKqtLyk2huQLscFyLhmJAZIlrCwlzCS6kd634CdB5K14NA8AL38jqIQN8zibklKO3OayBU+YotcLsmPxMF6iRMZygMQM71LAdmH0MxiXKjN4fbaEC01ca+ILhynWAnnQtm4u41IPTifYjFcodkHFR0vU88g6j6RlWb2n0Vur+QVvfkjQ43KHToaA+eQ0BhAjzLuQ4W5UJz59MZS84tvuk9ap4r6rzloRHcXisFcRaXn5k9AsEHMsWKUICxdtO3ksVXn5dBmGNQqSx91tZ18+zbthU7MBDwTArb1465TLCD+br4yKIaLnlhRIiwPRrC9fHFzzXk6qaQlnpkZfN 2020-10-05T11:50:15.614 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-10-05T11:50:15.662 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-10-05T11:50:15.680 INFO:teuthology.task.internal:Saving configuration 2020-10-05T11:50:15.693 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-10-05T11:50:15.704 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-10-05T11:50:15.722 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-10-05 11:44:32.245239', 'description': '/home/teuthworker/archive/yuvalif-2020-10-05_09:58:27-rgw-wip-yuval-static-analysis-distro-basic-smithi/5498204', 'locked_by': 'scheduled_yuvalif@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHZpdtuXFWQwd54+no/wsGHsgcNrJC6p38lD4QDvZPvC', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi158.front.sepia.ceph.com'} 2020-10-05T11:50:15.738 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-10-05 11:44:32.245259', 'description': '/home/teuthworker/archive/yuvalif-2020-10-05_09:58:27-rgw-wip-yuval-static-analysis-distro-basic-smithi/5498204', 'locked_by': 'scheduled_yuvalif@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIITbSRufOoeJWmjhXOHDhbtvJXZm8+fwwAdKJPWVegzb', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi081.front.sepia.ceph.com'} 2020-10-05T11:50:15.738 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-10-05T11:50:15.749 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2020-10-05T11:50:15.749 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2020-10-05T11:50:15.750 INFO:teuthology.run_tasks:Running task console_log... 2020-10-05T11:50:15.830 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa87a21f048>, signals=[15]) 2020-10-05T11:50:15.831 INFO:teuthology.run_tasks:Running task internal.connect... 2020-10-05T11:50:15.841 INFO:teuthology.task.internal:Opening connections... 2020-10-05T11:50:15.841 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi158.front.sepia.ceph.com 2020-10-05T11:50:15.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:50:15.917 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2020-10-05T11:50:15.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:50:15.991 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-10-05T11:50:16.000 INFO:teuthology.orchestra.run.smithi158:> uname -m 2020-10-05T11:50:16.115 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2020-10-05T11:50:16.116 INFO:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2020-10-05T11:50:16.165 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Ubuntu" 2020-10-05T11:50:16.165 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-10-05T11:50:16.165 INFO:teuthology.orchestra.run.smithi158.stdout:ID=ubuntu 2020-10-05T11:50:16.165 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE=debian 2020-10-05T11:50:16.165 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-10-05T11:50:16.166 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="18.04" 2020-10-05T11:50:16.166 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.ubuntu.com/" 2020-10-05T11:50:16.166 INFO:teuthology.orchestra.run.smithi158.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-10-05T11:50:16.166 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-10-05T11:50:16.166 INFO:teuthology.orchestra.run.smithi158.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-10-05T11:50:16.166 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_CODENAME=bionic 2020-10-05T11:50:16.166 INFO:teuthology.orchestra.run.smithi158.stdout:UBUNTU_CODENAME=bionic 2020-10-05T11:50:16.167 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2020-10-05T11:50:16.183 INFO:teuthology.orchestra.run.smithi081:> uname -m 2020-10-05T11:50:16.189 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2020-10-05T11:50:16.189 INFO:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2020-10-05T11:50:16.236 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2020-10-05T11:50:16.236 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-10-05T11:50:16.237 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2020-10-05T11:50:16.237 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2020-10-05T11:50:16.237 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-10-05T11:50:16.237 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="18.04" 2020-10-05T11:50:16.237 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2020-10-05T11:50:16.237 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-10-05T11:50:16.237 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-10-05T11:50:16.238 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-10-05T11:50:16.238 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=bionic 2020-10-05T11:50:16.238 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=bionic 2020-10-05T11:50:16.238 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2020-10-05T11:50:16.252 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-10-05T11:50:16.320 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-10-05T11:50:16.330 INFO:teuthology.task.internal:Checking for old test directory... 2020-10-05T11:50:16.331 INFO:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2020-10-05T11:50:16.333 INFO:teuthology.orchestra.run.smithi158:> test '!' -e /home/ubuntu/cephtest 2020-10-05T11:50:16.338 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-10-05T11:50:16.349 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-10-05T11:50:16.350 INFO:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2020-10-05T11:50:16.380 INFO:teuthology.orchestra.run.smithi158:> test -z $(ls -A /var/lib/ceph) 2020-10-05T11:50:16.396 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-10-05T11:50:16.442 INFO:teuthology.run_tasks:Running task kernel... 2020-10-05T11:50:16.457 DEBUG:teuthology.task.kernel:normalized config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c1.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c1.client.0': {'kdb': True, 'sha1': 'distro'}, 'c1.client.1': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c2.client.0': {'kdb': True, 'sha1': 'distro'}, 'c2.client.1': {'kdb': True, 'sha1': 'distro'}} 2020-10-05T11:50:16.458 INFO:teuthology.task.kernel:config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-10-05T11:50:16.458 INFO:teuthology.orchestra.run.smithi158:> uname -r 2020-10-05T11:50:16.464 INFO:teuthology.orchestra.run.smithi158.stdout:4.15.0-118-generic 2020-10-05T11:50:16.465 INFO:teuthology.task.kernel:Running kernel on smithi158: 4.15.0-118-generic 2020-10-05T11:50:16.465 INFO:teuthology.orchestra.run.smithi158:> sudo apt-get clean 2020-10-05T11:50:16.570 INFO:teuthology.orchestra.run.smithi158:> sudo apt-get update 2020-10-05T11:50:16.688 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-10-05T11:50:16.814 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-10-05T11:50:16.895 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-10-05T11:50:17.204 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-10-05T11:50:17.340 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,539 kB] 2020-10-05T11:50:17.734 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,669 kB] 2020-10-05T11:50:18.212 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 3,460 kB in 1s (2,444 kB/s) 2020-10-05T11:50:19.846 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2020-10-05T11:50:19.891 INFO:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-10-05T11:50:19.971 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2020-10-05T11:50:20.201 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2020-10-05T11:50:20.202 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2020-10-05T11:50:20.279 INFO:teuthology.orchestra.run.smithi158.stderr:E: Unable to locate package linux-image-current-generic 2020-10-05T11:50:20.280 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-10-05T11:50:20.280 INFO:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-10-05T11:50:20.359 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2020-10-05T11:50:20.595 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2020-10-05T11:50:20.595 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2020-10-05T11:50:20.796 INFO:teuthology.orchestra.run.smithi158.stdout:linux-image-generic is already the newest version (4.15.0.118.105). 2020-10-05T11:50:20.796 INFO:teuthology.orchestra.run.smithi158.stdout:linux-image-generic set to manually installed. 2020-10-05T11:50:20.796 INFO:teuthology.orchestra.run.smithi158.stdout:0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 2020-10-05T11:50:20.797 INFO:teuthology.orchestra.run.smithi158:> dpkg -s linux-image-generic 2020-10-05T11:50:20.820 INFO:teuthology.orchestra.run.smithi158.stdout:Package: linux-image-generic 2020-10-05T11:50:20.820 INFO:teuthology.orchestra.run.smithi158.stdout:Status: install ok installed 2020-10-05T11:50:20.820 INFO:teuthology.orchestra.run.smithi158.stdout:Priority: optional 2020-10-05T11:50:20.820 INFO:teuthology.orchestra.run.smithi158.stdout:Section: kernel 2020-10-05T11:50:20.821 INFO:teuthology.orchestra.run.smithi158.stdout:Installed-Size: 16 2020-10-05T11:50:20.821 INFO:teuthology.orchestra.run.smithi158.stdout:Maintainer: Ubuntu Kernel Team 2020-10-05T11:50:20.821 INFO:teuthology.orchestra.run.smithi158.stdout:Architecture: amd64 2020-10-05T11:50:20.821 INFO:teuthology.orchestra.run.smithi158.stdout:Source: linux-meta 2020-10-05T11:50:20.821 INFO:teuthology.orchestra.run.smithi158.stdout:Version: 4.15.0.118.105 2020-10-05T11:50:20.821 INFO:teuthology.orchestra.run.smithi158.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-10-05T11:50:20.821 INFO:teuthology.orchestra.run.smithi158.stdout:Depends: linux-image-4.15.0-118-generic, linux-modules-extra-4.15.0-118-generic, linux-firmware, intel-microcode, amd64-microcode 2020-10-05T11:50:20.822 INFO:teuthology.orchestra.run.smithi158.stdout:Recommends: thermald 2020-10-05T11:50:20.822 INFO:teuthology.orchestra.run.smithi158.stdout:Description: Generic Linux kernel image 2020-10-05T11:50:20.822 INFO:teuthology.orchestra.run.smithi158.stdout: This package will always depend on the latest generic kernel image 2020-10-05T11:50:20.822 INFO:teuthology.orchestra.run.smithi158.stdout: available. 2020-10-05T11:50:20.822 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-10-05T11:50:20.823 INFO:teuthology.orchestra.run.smithi081:> uname -r 2020-10-05T11:50:20.829 INFO:teuthology.orchestra.run.smithi081.stdout:4.15.0-118-generic 2020-10-05T11:50:20.829 INFO:teuthology.task.kernel:Running kernel on smithi081: 4.15.0-118-generic 2020-10-05T11:50:20.830 INFO:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2020-10-05T11:50:21.020 INFO:teuthology.orchestra.run.smithi081:> sudo apt-get update 2020-10-05T11:50:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-10-05T11:50:21.315 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-10-05T11:50:21.382 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-10-05T11:50:21.640 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-10-05T11:50:21.877 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,669 kB] 2020-10-05T11:50:22.281 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,539 kB] 2020-10-05T11:50:22.760 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 3,460 kB in 2s (2,293 kB/s) 2020-10-05T11:50:24.329 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2020-10-05T11:50:24.373 INFO:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-10-05T11:50:24.455 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2020-10-05T11:50:24.710 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2020-10-05T11:50:24.710 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2020-10-05T11:50:24.792 INFO:teuthology.orchestra.run.smithi081.stderr:E: Unable to locate package linux-image-current-generic 2020-10-05T11:50:24.794 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-10-05T11:50:24.794 INFO:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-10-05T11:50:24.872 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2020-10-05T11:50:25.107 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2020-10-05T11:50:25.108 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2020-10-05T11:50:25.317 INFO:teuthology.orchestra.run.smithi081.stdout:linux-image-generic is already the newest version (4.15.0.118.105). 2020-10-05T11:50:25.317 INFO:teuthology.orchestra.run.smithi081.stdout:linux-image-generic set to manually installed. 2020-10-05T11:50:25.317 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 2020-10-05T11:50:25.318 INFO:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2020-10-05T11:50:25.333 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2020-10-05T11:50:25.333 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2020-10-05T11:50:25.333 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2020-10-05T11:50:25.333 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2020-10-05T11:50:25.334 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 16 2020-10-05T11:50:25.334 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2020-10-05T11:50:25.334 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2020-10-05T11:50:25.334 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2020-10-05T11:50:25.334 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 4.15.0.118.105 2020-10-05T11:50:25.334 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-10-05T11:50:25.334 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-4.15.0-118-generic, linux-modules-extra-4.15.0-118-generic, linux-firmware, intel-microcode, amd64-microcode 2020-10-05T11:50:25.335 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2020-10-05T11:50:25.335 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2020-10-05T11:50:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2020-10-05T11:50:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2020-10-05T11:50:25.335 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-10-05T11:50:25.336 INFO:teuthology.task.kernel:Enabling kdb on c1.mon.a... 2020-10-05T11:50:25.336 INFO:teuthology.orchestra.run.smithi158:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-10-05T11:50:25.362 INFO:teuthology.orchestra.run.smithi158.stdout:ttyS1 2020-10-05T11:50:25.386 INFO:teuthology.task.kernel:Enabling kdb on c2.mon.a... 2020-10-05T11:50:25.386 INFO:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-10-05T11:50:25.399 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2020-10-05T11:50:25.420 INFO:teuthology.run_tasks:Running task internal.base... 2020-10-05T11:50:25.429 INFO:teuthology.task.internal:Creating test directory... 2020-10-05T11:50:25.430 INFO:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-10-05T11:50:25.464 INFO:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-10-05T11:50:25.471 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-10-05T11:50:25.481 INFO:teuthology.run_tasks:Running task internal.archive... 2020-10-05T11:50:25.495 INFO:teuthology.task.internal:Creating archive directory... 2020-10-05T11:50:25.495 INFO:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-10-05T11:50:25.512 INFO:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-10-05T11:50:25.530 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-10-05T11:50:25.541 INFO:teuthology.task.internal:Enabling coredump saving... 2020-10-05T11:50:25.542 INFO:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-10-05T11:50:25.572 INFO:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-10-05T11:50:25.591 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-10-05T11:50:25.594 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-10-05T11:50:25.599 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-10-05T11:50:25.602 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-10-05T11:50:25.604 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-10-05T11:50:25.613 INFO:teuthology.task.internal:Configuring sudo... 2020-10-05T11:50:25.614 INFO:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-10-05T11:50:25.648 INFO:teuthology.orchestra.run.smithi158:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-10-05T11:50:25.663 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-10-05T11:50:25.675 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-10-05T11:50:25.675 INFO:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-10-05T11:50:25.704 INFO:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-10-05T11:50:25.713 INFO:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-10-05T11:50:25.761 INFO:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-10-05T11:50:25.809 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:50:25.810 INFO:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-10-05T11:50:25.855 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-10-05T11:50:25.874 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:50:25.875 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:50:25.875 INFO:teuthology.orchestra.run.smithi158.stderr:152 bytes copied, 3.3407e-05 s, 4.5 MB/s 2020-10-05T11:50:25.876 INFO:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-10-05T11:50:25.882 INFO:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-10-05T11:50:25.928 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:50:25.929 INFO:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-10-05T11:50:25.975 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-10-05T11:50:25.994 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:50:25.994 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:50:25.995 INFO:teuthology.orchestra.run.smithi081.stderr:152 bytes copied, 3.1379e-05 s, 4.8 MB/s 2020-10-05T11:50:25.996 INFO:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2020-10-05T11:50:26.040 INFO:teuthology.orchestra.run.smithi158:> sudo service rsyslog restart 2020-10-05T11:50:26.081 INFO:teuthology.run_tasks:Running task internal.timer... 2020-10-05T11:50:26.093 INFO:teuthology.task.internal:Starting timer... 2020-10-05T11:50:26.094 INFO:teuthology.run_tasks:Running task pcp... 2020-10-05T11:50:26.109 INFO:teuthology.run_tasks:Running task selinux... 2020-10-05T11:50:26.123 DEBUG:teuthology.task.selinux:Excluding smithi158: OS 'ubuntu' does not support SELinux 2020-10-05T11:50:26.123 DEBUG:teuthology.task.selinux:Excluding smithi081: OS 'ubuntu' does not support SELinux 2020-10-05T11:50:26.124 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-10-05T11:50:26.124 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2020-10-05T11:50:26.124 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-10-05T11:50:26.124 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-10-05T11:50:26.138 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-10-05T11:50:26.144 INFO:teuthology.repo_utils:Fetching master from origin 2020-10-05T11:50:26.189 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-10-05T11:50:26.204 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-10-05T11:50:26.205 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi158.front.sepia.ceph.com,smithi081.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-10-05T11:50:26.506 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-10-05T11:50:27.299 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-10-05T11:50:29.315 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-10-05T11:50:29.333 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:29 +0000 (0:00:00.064) 0:00:00.064 ******** 2020-10-05T11:50:29.347 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:29 +0000 (0:00:00.013) 0:00:00.078 ******** 2020-10-05T11:50:30.975 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi081.front.sepia.ceph.com] 2020-10-05T11:50:31.047 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:31 +0000 (0:00:01.700) 0:00:01.778 ******** 2020-10-05T11:50:31.057 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] 2020-10-05T11:50:31.130 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:31 +0000 (0:00:00.082) 0:00:01.860 ******** 2020-10-05T11:50:31.395 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-10-05T11:50:31.397 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-10-05T11:50:31.429 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:31 +0000 (0:00:00.299) 0:00:02.160 ******** 2020-10-05T11:50:31.460 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:31 +0000 (0:00:00.030) 0:00:02.191 ******** 2020-10-05T11:50:31.965 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-10-05T11:50:31.967 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-10-05T11:50:31.967 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-10-05T11:50:32.001 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:31 +0000 (0:00:00.540) 0:00:02.732 ******** 2020-10-05T11:50:32.032 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:32 +0000 (0:00:00.030) 0:00:02.762 ******** 2020-10-05T11:50:32.420 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-10-05T11:50:32.422 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.073762", "end": "2020-10-05 11:50:32.302000", "rc": 0, "start": "2020-10-05 11:50:32.228238", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-10-05T11:50:32.454 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:32 +0000 (0:00:00.422) 0:00:03.185 ******** 2020-10-05T11:50:32.709 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.356535", "end": "2020-10-05 11:50:32.420689", "rc": 0, "start": "2020-10-05 11:50:32.064154", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-10-05T11:50:32.744 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:32 +0000 (0:00:00.289) 0:00:03.475 ******** 2020-10-05T11:50:32.792 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-10-05T11:50:32.795 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-05T11:50:32.859 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:32 +0000 (0:00:00.115) 0:00:03.590 ******** 2020-10-05T11:50:32.883 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-05T11:50:32.921 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:32 +0000 (0:00:00.061) 0:00:03.652 ******** 2020-10-05T11:50:33.688 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-10-05T11:50:33.689 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1601898632.8831046-265558712360342/source", "state": "file", "uid": 0} changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1601898632.935049-234282640376515/source", "state": "file", "uid": 0} 2020-10-05T11:50:33.725 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:33 +0000 (0:00:00.803) 0:00:04.455 ******** 2020-10-05T11:50:33.758 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:33 +0000 (0:00:00.032) 0:00:04.488 ******** 2020-10-05T11:50:34.013 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-10-05T11:50:34.015 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-10-05T11:50:34.017 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2020-10-05T11:50:34.018 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2020-10-05T11:50:34.020 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-10-05T11:50:34.147 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-10-05T11:50:34.154 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-10-05T11:50:34.291 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:34 +0000 (0:00:00.533) 0:00:05.022 ******** 2020-10-05T11:50:34.323 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:34 +0000 (0:00:00.031) 0:00:05.054 ******** 2020-10-05T11:50:35.035 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi081.front.sepia.ceph.com] 2020-10-05T11:50:35.113 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-10-05T11:50:35.114 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:35 +0000 (0:00:00.789) 0:00:05.844 ******** 2020-10-05T11:50:35.462 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-10-05T11:50:35.464 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.157229", "end": "2020-10-05 11:50:35.435227", "rc": 0, "start": "2020-10-05 11:50:35.277998", "stderr": "", "stderr_lines": [], "stdout": "9443d15ff7024b0631afa66ceb58a9a8ee18727c", "stdout_lines": ["9443d15ff7024b0631afa66ceb58a9a8ee18727c"]} 2020-10-05T11:50:35.514 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:35 +0000 (0:00:00.400) 0:00:06.245 ******** 2020-10-05T11:50:35.660 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-10-05T11:50:35.661 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016137", "end": "2020-10-05 11:50:35.544121", "failed_when_result": false, "rc": 0, "start": "2020-10-05 11:50:35.527984", "stderr": "", "stderr_lines": [], "stdout": "9443d15ff7024b0631afa66ceb58a9a8ee18727c", "stdout_lines": ["9443d15ff7024b0631afa66ceb58a9a8ee18727c"]} 2020-10-05T11:50:35.698 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:35 +0000 (0:00:00.183) 0:00:06.429 ******** 2020-10-05T11:50:35.725 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-10-05T11:50:35.727 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-10-05T11:50:35.763 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:35 +0000 (0:00:00.065) 0:00:06.494 ******** 2020-10-05T11:50:35.791 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-10-05T11:50:35.793 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:35.828 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:35 +0000 (0:00:00.065) 0:00:06.559 ******** 2020-10-05T11:50:35.856 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-10-05T11:50:35.857 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:35.908 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:35 +0000 (0:00:00.079) 0:00:06.639 ******** 2020-10-05T11:50:35.937 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-10-05T11:50:35.939 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:35.989 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:35 +0000 (0:00:00.081) 0:00:06.720 ******** 2020-10-05T11:50:36.019 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-10-05T11:50:36.021 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.058 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:36 +0000 (0:00:00.068) 0:00:06.788 ******** 2020-10-05T11:50:36.078 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi158.front.sepia.ceph.com] 2020-10-05T11:50:36.085 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-10-05T11:50:36.087 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.120 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:36 +0000 (0:00:00.062) 0:00:06.851 ******** 2020-10-05T11:50:36.193 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:36 +0000 (0:00:00.073) 0:00:06.924 ******** 2020-10-05T11:50:36.200 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-05T11:50:36.201 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.203 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2020-10-05T11:50:36.205 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.215 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.216 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.226 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.228 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.238 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.239 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.251 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.252 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.264 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.265 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.277 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.278 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.290 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.291 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.293 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.304 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.305 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.307 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.317 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.319 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.330 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.331 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.333 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.343 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.344 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.355 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.357 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.367 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.368 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.378 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.379 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.380 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.390 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.392 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.403 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.404 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.414 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.416 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.426 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.426 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.437 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.441 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.443 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.453 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.454 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.464 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.465 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.475 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.477 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.487 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.489 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.499 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.501 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.512 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.522 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.524 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.534 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.535 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.545 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-10-05T11:50:36.547 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.156289", "end": "2020-10-05 11:50:36.507467", "rc": 0, "start": "2020-10-05 11:50:36.351178", "stderr": "", "stderr_lines": [], "stdout": "9443d15ff7024b0631afa66ceb58a9a8ee18727c", "stdout_lines": ["9443d15ff7024b0631afa66ceb58a9a8ee18727c"]} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.547 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora aQ7SNya+XVgPs7WBN9jxwg 8a7b6c17443fb46062210cfded863de959fd3ac565fc86c759f1763364b6711d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora aQ7SNya+XVgPs7WBN9jxwg 8a7b6c17443fb46062210cfded863de959fd3ac565fc86c759f1763364b6711d"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.581 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:36 +0000 (0:00:00.387) 0:00:07.312 ******** 2020-10-05T11:50:36.588 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.589 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.589 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.590 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.590 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.591 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468f 2020-10-05T11:50:36.593 INFO:teuthology.task.ansible.out:e695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.603 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.605 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.614 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.616 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.626 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.627 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.637 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.638 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.649 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.650 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.660 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.661 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.671 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.673 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.683 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.684 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.694 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.695 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.695 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.706 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.708 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.718 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.719 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.730 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-10-05T11:50:36.731 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013849", "end": "2020-10-05 11:50:36.445538", "failed_when_result": false, "rc": 0, "start": "2020-10-05 11:50:36.431689", "stderr": "", "stderr_lines": [], "stdout": "9443d15ff7024b0631afa66ceb58a9a8ee18727c", "stdout_lines": ["9443d15ff7024b0631afa66ceb58a9a8ee18727c"]} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.766 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:36 +0000 (0:00:00.184) 0:00:07.497 ******** 2020-10-05T11:50:36.772 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.773 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.774 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.775 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.775 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBo 2020-10-05T11:50:36.777 INFO:teuthology.task.ansible.out:x 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.787 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.788 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.799 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-10-05T11:50:36.801 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.835 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:36 +0000 (0:00:00.069) 0:00:07.566 ******** 2020-10-05T11:50:36.842 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.842 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.844 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.859 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:36.892 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:36 +0000 (0:00:00.057) 0:00:07.623 ******** 2020-10-05T11:50:36.925 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:36 +0000 (0:00:00.031) 0:00:07.655 ******** 2020-10-05T11:50:36.931 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-10-05T11:50:36.967 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:36 +0000 (0:00:00.042) 0:00:07.697 ******** 2020-10-05T11:50:36.975 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-10-05T11:50:36.977 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.009 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:37 +0000 (0:00:00.042) 0:00:07.740 ******** 2020-10-05T11:50:37.016 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-10-05T11:50:37.017 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.055 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:37 +0000 (0:00:00.045) 0:00:07.786 ******** 2020-10-05T11:50:37.062 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-10-05T11:50:37.063 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.097 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:37 +0000 (0:00:00.042) 0:00:07.828 ******** 2020-10-05T11:50:37.103 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-10-05T11:50:37.105 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.138 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:37 +0000 (0:00:00.041) 0:00:07.869 ******** 2020-10-05T11:50:37.145 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-10-05T11:50:37.147 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.180 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:37 +0000 (0:00:00.041) 0:00:07.911 ******** 2020-10-05T11:50:37.186 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-10-05T11:50:37.188 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.221 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:37 +0000 (0:00:00.040) 0:00:07.952 ******** 2020-10-05T11:50:37.227 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-10-05T11:50:37.229 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.265 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:37 +0000 (0:00:00.044) 0:00:07.996 ******** 2020-10-05T11:50:37.271 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-10-05T11:50:37.273 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.307 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:37 +0000 (0:00:00.041) 0:00:08.038 ******** 2020-10-05T11:50:37.315 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.316 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.326 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.328 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2020-10-05T11:50:37.330 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.363 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:37 +0000 (0:00:00.055) 0:00:08.093 ******** 2020-10-05T11:50:37.370 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-05T11:50:37.371 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.372 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.373 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.374 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAA 2020-10-05T11:50:37.375 INFO:teuthology.task.ansible.out:AADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2020-10-05T11:50:37.377 INFO:teuthology.task.ansible.out:"aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystree 2020-10-05T11:50:37.379 INFO:teuthology.task.ansible.out:t', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.387 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.388 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.399 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.400 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.401 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.402 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.413 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.415 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-10-05T11:50:37.416 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e75443 2020-10-05T11:50:37.417 INFO:teuthology.task.ansible.out:4de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.426 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-05T11:50:37.428 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKm 2020-10-05T11:50:37.430 INFO:teuthology.task.ansible.out:A 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.430 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.441 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-05T11:50:37.443 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.443 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_va 2020-10-05T11:50:37.445 INFO:teuthology.task.ansible.out:r": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.454 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-05T11:50:37.456 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.456 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.458 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.458 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-05T11:50:37.458 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.469 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.470 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-05T11:50:37.470 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.477 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-05T11:50:37.478 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.479 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.490 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.492 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.492 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-05T11:50:37.492 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.493 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-05T11:50:37.493 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.504 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-05T11:50:37.506 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2020-10-05T11:50:37.506 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.517 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.519 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.531 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-05T11:50:37.533 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.534 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.544 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-05T11:50:37.546 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-10-05T11:50:37.547 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.547 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ************** 2020-10-05T11:50:37.549 INFO:teuthology.task.ansible.out:****************************** skipping: [smithi081.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.559 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.561 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.561 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-05T11:50:37.561 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.572 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.574 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.574 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.585 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-05T11:50:37.587 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.598 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.600 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi081.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.602 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-05T11:50:37.603 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.640 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:37 +0000 (0:00:00.277) 0:00:08.371 ******** 2020-10-05T11:50:37.651 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.653 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.654 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.656 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.657 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.658 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.658 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbc 2020-10-05T11:50:37.660 INFO:teuthology.task.ansible.out:cc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.671 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.674 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.683 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.686 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.696 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.707 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.710 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.719 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.721 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.731 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.733 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.743 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora aQ7SNya+XVgPs7WBN9jxwg 8a7b6c17443fb46062210cfded863de959fd3ac565fc86c759f1763364b6711d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora aQ7SNya+XVgPs7WBN9jxwg 8a7b6c17443fb46062210cfded863de959fd3ac565fc86c759f1763364b6711d"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.754 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.756 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.765 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.767 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.778 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.780 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.789 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.791 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.801 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.803 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.813 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.814 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.824 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.825 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.836 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.837 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.838 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.849 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.850 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.861 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.863 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.873 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.875 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.885 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.887 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.897 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.898 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.909 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.911 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.921 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.922 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.933 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.934 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.936 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.946 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.948 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.960 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.962 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.973 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.984 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.986 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.996 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:37.998 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.008 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.009 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.010 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.021 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.033 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.035 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.045 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.046 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.106 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.465) 0:00:08.836 ******** 2020-10-05T11:50:38.112 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-10-05T11:50:38.114 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "d9fb9f279e899db10a88608beafde686505dd97b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2020-10-05T11:50:38.150 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.043) 0:00:08.880 ******** 2020-10-05T11:50:38.156 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-10-05T11:50:38.197 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.048) 0:00:08.928 ******** 2020-10-05T11:50:38.203 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-10-05T11:50:38.205 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => { "msg": "Host smithi081.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-10-05T11:50:38.240 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.042) 0:00:08.971 ******** 2020-10-05T11:50:38.247 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-10-05T11:50:38.249 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.287 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.046) 0:00:09.018 ******** 2020-10-05T11:50:38.293 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-10-05T11:50:38.295 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-10-05T11:50:38.328 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.041) 0:00:09.059 ******** 2020-10-05T11:50:38.336 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-10-05T11:50:38.337 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.381 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.052) 0:00:09.112 ******** 2020-10-05T11:50:38.388 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-10-05T11:50:38.390 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.424 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.043) 0:00:09.155 ******** 2020-10-05T11:50:38.432 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-10-05T11:50:38.434 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.466 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.041) 0:00:09.196 ******** 2020-10-05T11:50:38.472 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-10-05T11:50:38.473 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.508 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.042) 0:00:09.239 ******** 2020-10-05T11:50:38.515 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-10-05T11:50:38.516 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.553 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.044) 0:00:09.284 ******** 2020-10-05T11:50:38.559 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-10-05T11:50:38.561 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.596 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.043) 0:00:09.327 ******** 2020-10-05T11:50:38.603 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-10-05T11:50:38.605 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.638 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.042) 0:00:09.369 ******** 2020-10-05T11:50:38.644 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-10-05T11:50:38.645 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.681 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.042) 0:00:09.412 ******** 2020-10-05T11:50:38.690 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-05T11:50:38.691 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.692 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.693 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.704 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.706 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi158.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.743 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.061) 0:00:09.474 ******** 2020-10-05T11:50:38.751 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.752 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.753 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.753 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.754 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.755 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.766 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.767 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi158.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.805 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.062) 0:00:09.536 ******** 2020-10-05T11:50:38.813 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.814 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.815 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.815 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.816 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.817 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.818 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.818 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.829 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.830 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi158.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.865 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.060) 0:00:09.596 ******** 2020-10-05T11:50:38.872 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.874 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.874 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.875 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.875 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.913 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.047) 0:00:09.644 ******** 2020-10-05T11:50:38.919 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-10-05T11:50:38.921 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:38.956 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:38 +0000 (0:00:00.042) 0:00:09.687 ******** 2020-10-05T11:50:38.994 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-10-05T11:50:38.996 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi081.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-05T11:50:39.031 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.074) 0:00:09.761 ******** 2020-10-05T11:50:39.063 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-10-05T11:50:39.065 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:39.098 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.067) 0:00:09.829 ******** 2020-10-05T11:50:39.125 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-10-05T11:50:39.126 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:39.182 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.084) 0:00:09.913 ******** 2020-10-05T11:50:39.210 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-10-05T11:50:39.211 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-05T11:50:39.244 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.061) 0:00:09.975 ******** 2020-10-05T11:50:39.250 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-10-05T11:50:39.252 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "d9fb9f279e899db10a88608beafde686505dd97b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2020-10-05T11:50:39.285 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.041) 0:00:10.016 ******** 2020-10-05T11:50:39.292 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-10-05T11:50:39.293 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:39.327 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.041) 0:00:10.058 ******** 2020-10-05T11:50:39.333 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-10-05T11:50:39.335 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => { "msg": "Host smithi158.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-10-05T11:50:39.368 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.040) 0:00:10.099 ******** 2020-10-05T11:50:39.374 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-10-05T11:50:39.376 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-05T11:50:39.410 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.041) 0:00:10.141 ******** 2020-10-05T11:50:39.417 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-10-05T11:50:39.419 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-10-05T11:50:39.452 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.042) 0:00:10.183 ******** 2020-10-05T11:50:39.458 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-10-05T11:50:39.460 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:39.497 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.044) 0:00:10.228 ******** 2020-10-05T11:50:39.504 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-10-05T11:50:39.506 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:39.540 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.042) 0:00:10.271 ******** 2020-10-05T11:50:39.549 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-10-05T11:50:39.550 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:39.584 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.043) 0:00:10.314 ******** 2020-10-05T11:50:39.590 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-10-05T11:50:39.592 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:39.626 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.042) 0:00:10.357 ******** 2020-10-05T11:50:39.632 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-10-05T11:50:39.634 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:39.667 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.041) 0:00:10.398 ******** 2020-10-05T11:50:39.674 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-10-05T11:50:39.675 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:39.713 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.045) 0:00:10.443 ******** 2020-10-05T11:50:39.719 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-10-05T11:50:39.721 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:39.756 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.043) 0:00:10.487 ******** 2020-10-05T11:50:39.764 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-10-05T11:50:39.766 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:39.799 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.042) 0:00:10.530 ******** 2020-10-05T11:50:39.807 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-10-05T11:50:39.808 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-05T11:50:39.843 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.043) 0:00:10.574 ******** 2020-10-05T11:50:39.849 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-10-05T11:50:39.850 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:39.887 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.044) 0:00:10.618 ******** 2020-10-05T11:50:39.894 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-10-05T11:50:39.895 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:39.929 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.041) 0:00:10.660 ******** 2020-10-05T11:50:39.935 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-10-05T11:50:39.937 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:39.971 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:39 +0000 (0:00:00.041) 0:00:10.702 ******** 2020-10-05T11:50:39.977 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-10-05T11:50:39.979 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.013 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.042) 0:00:10.744 ******** 2020-10-05T11:50:40.021 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-10-05T11:50:40.023 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.070 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.056) 0:00:10.800 ******** 2020-10-05T11:50:40.078 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-10-05T11:50:40.079 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.115 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.045) 0:00:10.846 ******** 2020-10-05T11:50:40.121 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-10-05T11:50:40.123 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.157 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.041) 0:00:10.887 ******** 2020-10-05T11:50:40.163 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-10-05T11:50:40.165 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.203 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.046) 0:00:10.934 ******** 2020-10-05T11:50:40.212 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-10-05T11:50:40.214 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-05T11:50:40.257 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.053) 0:00:10.988 ******** 2020-10-05T11:50:40.263 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-10-05T11:50:40.265 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.298 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.040) 0:00:11.029 ******** 2020-10-05T11:50:40.305 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-10-05T11:50:40.307 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.339 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.041) 0:00:11.070 ******** 2020-10-05T11:50:40.345 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-10-05T11:50:40.347 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.384 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.045) 0:00:11.115 ******** 2020-10-05T11:50:40.391 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-10-05T11:50:40.393 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.427 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.042) 0:00:11.157 ******** 2020-10-05T11:50:40.433 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-10-05T11:50:40.435 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-05T11:50:40.470 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.043) 0:00:11.201 ******** 2020-10-05T11:50:40.477 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-10-05T11:50:40.479 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-05T11:50:40.512 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.041) 0:00:11.243 ******** 2020-10-05T11:50:40.518 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-10-05T11:50:40.519 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.553 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.041) 0:00:11.284 ******** 2020-10-05T11:50:40.562 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.596 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.042) 0:00:11.326 ******** 2020-10-05T11:50:40.602 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-10-05T11:50:40.604 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.639 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.042) 0:00:11.369 ******** 2020-10-05T11:50:40.646 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-10-05T11:50:40.648 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-05T11:50:40.681 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.042) 0:00:11.412 ******** 2020-10-05T11:50:40.689 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-10-05T11:50:40.691 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.724 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.043) 0:00:11.455 ******** 2020-10-05T11:50:40.731 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-10-05T11:50:40.733 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.768 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.043) 0:00:11.499 ******** 2020-10-05T11:50:40.775 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-10-05T11:50:40.777 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.813 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.045) 0:00:11.544 ******** 2020-10-05T11:50:40.821 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-10-05T11:50:40.823 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.863 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.049) 0:00:11.593 ******** 2020-10-05T11:50:40.869 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-10-05T11:50:40.871 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.906 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.043) 0:00:11.637 ******** 2020-10-05T11:50:40.913 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-10-05T11:50:40.915 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.948 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.042) 0:00:11.679 ******** 2020-10-05T11:50:40.956 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-10-05T11:50:40.957 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:40.991 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:40 +0000 (0:00:00.042) 0:00:11.721 ******** 2020-10-05T11:50:40.998 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-10-05T11:50:41.000 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.042 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.051) 0:00:11.773 ******** 2020-10-05T11:50:41.069 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-10-05T11:50:41.071 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-05T11:50:41.104 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.061) 0:00:11.835 ******** 2020-10-05T11:50:41.131 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-10-05T11:50:41.132 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.167 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.062) 0:00:11.897 ******** 2020-10-05T11:50:41.174 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-10-05T11:50:41.175 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.015668", "end": "2020-10-05 11:50:41.030685", "rc": 0, "start": "2020-10-05 11:50:41.015017", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-10-05T11:50:41.215 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.048) 0:00:11.946 ******** 2020-10-05T11:50:41.224 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-10-05T11:50:41.225 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.259 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.043) 0:00:11.990 ******** 2020-10-05T11:50:41.266 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-10-05T11:50:41.268 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.302 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.043) 0:00:12.033 ******** 2020-10-05T11:50:41.310 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-10-05T11:50:41.312 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.346 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.044) 0:00:12.077 ******** 2020-10-05T11:50:41.353 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-10-05T11:50:41.355 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.394 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.047) 0:00:12.125 ******** 2020-10-05T11:50:41.401 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-10-05T11:50:41.403 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.439 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.045) 0:00:12.170 ******** 2020-10-05T11:50:41.446 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-10-05T11:50:41.448 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.483 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.043) 0:00:12.213 ******** 2020-10-05T11:50:41.491 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-10-05T11:50:41.493 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.532 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.049) 0:00:12.263 ******** 2020-10-05T11:50:41.539 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-10-05T11:50:41.541 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.579 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.047) 0:00:12.310 ******** 2020-10-05T11:50:41.586 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-10-05T11:50:41.588 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.623 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.044) 0:00:12.354 ******** 2020-10-05T11:50:41.630 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-10-05T11:50:41.631 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.668 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.043) 0:00:12.398 ******** 2020-10-05T11:50:41.675 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-10-05T11:50:41.677 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-05T11:50:41.715 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.047) 0:00:12.446 ******** 2020-10-05T11:50:41.722 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-10-05T11:50:41.723 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.759 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.043) 0:00:12.489 ******** 2020-10-05T11:50:41.767 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-10-05T11:50:41.768 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.804 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.045) 0:00:12.535 ******** 2020-10-05T11:50:41.811 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-10-05T11:50:41.813 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.849 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.045) 0:00:12.580 ******** 2020-10-05T11:50:41.857 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-10-05T11:50:41.859 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.899 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.049) 0:00:12.630 ******** 2020-10-05T11:50:41.926 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-10-05T11:50:41.928 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:41.961 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:41 +0000 (0:00:00.061) 0:00:12.692 ******** 2020-10-05T11:50:41.999 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-10-05T11:50:42.000 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:42.036 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:42 +0000 (0:00:00.075) 0:00:12.767 ******** 2020-10-05T11:50:42.063 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-10-05T11:50:42.065 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:42.074 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:42.111 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:42 +0000 (0:00:00.074) 0:00:12.842 ******** 2020-10-05T11:50:42.138 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-10-05T11:50:42.140 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:42.173 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:42 +0000 (0:00:00.062) 0:00:12.904 ******** 2020-10-05T11:50:42.428 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-10-05T11:50:42.430 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.123245", "end": "2020-10-05 11:50:42.147573", "rc": 0, "start": "2020-10-05 11:50:42.024328", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-10-05T11:50:42.462 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:42 +0000 (0:00:00.288) 0:00:13.193 ******** 2020-10-05T11:50:42.488 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-10-05T11:50:42.490 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:42.522 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:42 +0000 (0:00:00.060) 0:00:13.253 ******** 2020-10-05T11:50:42.548 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-10-05T11:50:42.550 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:42.582 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:42 +0000 (0:00:00.060) 0:00:13.313 ******** 2020-10-05T11:50:42.608 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-10-05T11:50:42.610 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:42.642 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:42 +0000 (0:00:00.059) 0:00:13.372 ******** 2020-10-05T11:50:42.648 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-10-05T11:50:42.655 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.636746", "end": "2020-10-05 11:50:42.500335", "rc": 0, "start": "2020-10-05 11:50:41.863589", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:50:42.689 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:42 +0000 (0:00:00.047) 0:00:13.420 ******** 2020-10-05T11:50:42.696 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-10-05T11:50:42.698 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:42.731 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:42 +0000 (0:00:00.041) 0:00:13.462 ******** 2020-10-05T11:50:42.737 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-10-05T11:50:42.739 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:42.775 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:42 +0000 (0:00:00.044) 0:00:13.506 ******** 2020-10-05T11:50:42.782 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-10-05T11:50:42.784 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:42.819 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:42 +0000 (0:00:00.043) 0:00:13.550 ******** 2020-10-05T11:50:42.846 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-10-05T11:50:42.848 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:42.881 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:42 +0000 (0:00:00.062) 0:00:13.612 ******** 2020-10-05T11:50:42.907 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:42.941 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:42 +0000 (0:00:00.060) 0:00:13.672 ******** 2020-10-05T11:50:42.948 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-10-05T11:50:42.950 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi081.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.028804", "end": "2020-10-05 11:50:42.813844", "rc": 0, "start": "2020-10-05 11:50:42.785040", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:50:42.985 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:42 +0000 (0:00:00.043) 0:00:13.716 ******** 2020-10-05T11:50:43.774 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-10-05T11:50:43.775 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.716154", "end": "2020-10-05 11:50:43.500323", "rc": 0, "start": "2020-10-05 11:50:42.784169", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:50:43.809 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:43 +0000 (0:00:00.823) 0:00:14.539 ******** 2020-10-05T11:50:43.835 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-10-05T11:50:43.837 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:43.870 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:43 +0000 (0:00:00.061) 0:00:14.601 ******** 2020-10-05T11:50:44.022 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-10-05T11:50:44.024 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.027172", "end": "2020-10-05 11:50:43.742236", "rc": 0, "start": "2020-10-05 11:50:43.715064", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:50:44.064 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:44 +0000 (0:00:00.193) 0:00:14.795 ******** 2020-10-05T11:50:46.025 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-10-05T11:50:46.026 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1601898622, "cache_updated": false, "changed": false} 2020-10-05T11:50:46.059 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:46 +0000 (0:00:01.994) 0:00:16.790 ******** 2020-10-05T11:50:46.951 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-10-05T11:50:46.953 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"cache_update_time": 1601898622, "cache_updated": false, "changed": false} 2020-10-05T11:50:46.985 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:46 +0000 (0:00:00.925) 0:00:17.716 ******** 2020-10-05T11:50:47.002 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-10-05T11:50:47.003 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1601898617, "cache_updated": false, "changed": false} 2020-10-05T11:50:47.036 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:47 +0000 (0:00:00.050) 0:00:17.767 ******** 2020-10-05T11:50:47.042 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-10-05T11:50:47.043 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:47.077 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:47 +0000 (0:00:00.041) 0:00:17.808 ******** 2020-10-05T11:50:47.365 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-10-05T11:50:47.367 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-10-05T11:50:47.399 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:47 +0000 (0:00:00.321) 0:00:18.130 ******** 2020-10-05T11:50:47.900 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1601898617, "cache_updated": false, "changed": false} 2020-10-05T11:50:47.935 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:47 +0000 (0:00:00.536) 0:00:18.666 ******** 2020-10-05T11:50:47.962 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-10-05T11:50:47.964 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:47.996 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:47 +0000 (0:00:00.060) 0:00:18.727 ******** 2020-10-05T11:50:48.251 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-10-05T11:50:48.252 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"cache_update_time": 1601898622, "cache_updated": false, "changed": false} 2020-10-05T11:50:48.286 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:48 +0000 (0:00:00.290) 0:00:19.017 ******** 2020-10-05T11:50:48.302 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-10-05T11:50:48.304 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-10-05T11:50:48.338 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:48 +0000 (0:00:00.052) 0:00:19.069 ******** 2020-10-05T11:50:48.603 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-10-05T11:50:48.605 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-10-05T11:50:48.874 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-10-05T11:50:49.133 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-10-05T11:50:49.172 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:49 +0000 (0:00:00.833) 0:00:19.902 ******** 2020-10-05T11:50:49.178 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-10-05T11:50:49.180 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1601898617, "cache_updated": false, "changed": false} 2020-10-05T11:50:49.223 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:49 +0000 (0:00:00.051) 0:00:19.954 ******** 2020-10-05T11:50:49.293 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-10-05T11:50:49.294 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-10-05T11:50:49.334 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:49 +0000 (0:00:00.110) 0:00:20.064 ******** 2020-10-05T11:50:49.549 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-10-05T11:50:49.550 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-10-05T11:50:49.635 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-10-05T11:50:49.637 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-10-05T11:50:49.824 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-10-05T11:50:49.826 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-10-05T11:50:49.898 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-10-05T11:50:49.900 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-10-05T11:50:50.085 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-10-05T11:50:50.087 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-10-05T11:50:50.122 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:50 +0000 (0:00:00.788) 0:00:20.853 ******** 2020-10-05T11:50:50.160 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-10-05T11:50:50.162 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-10-05T11:50:50.198 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:50 +0000 (0:00:00.076) 0:00:20.929 ******** 2020-10-05T11:50:50.236 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-10-05T11:50:50.238 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-10-05T11:50:50.270 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:50 +0000 (0:00:00.071) 0:00:21.001 ******** 2020-10-05T11:50:50.277 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-10-05T11:50:50.278 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-10-05T11:50:50.312 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:50 +0000 (0:00:00.041) 0:00:21.043 ******** 2020-10-05T11:50:50.318 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-10-05T11:50:50.319 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:50.353 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:50 +0000 (0:00:00.040) 0:00:21.084 ******** 2020-10-05T11:50:50.381 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-10-05T11:50:50.382 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-05T11:50:50.414 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:50 +0000 (0:00:00.061) 0:00:21.145 ******** 2020-10-05T11:50:50.453 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-10-05T11:50:50.454 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:50.464 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:50.465 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:50.498 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:50 +0000 (0:00:00.084) 0:00:21.229 ******** 2020-10-05T11:50:50.524 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-10-05T11:50:50.526 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:50.558 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:50 +0000 (0:00:00.059) 0:00:21.289 ******** 2020-10-05T11:50:50.606 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-10-05T11:50:50.608 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-10-05T11:50:50.877 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-10-05T11:50:51.136 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-10-05T11:50:51.177 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:51 +0000 (0:00:00.618) 0:00:21.908 ******** 2020-10-05T11:50:51.214 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-10-05T11:50:51.216 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-10-05T11:50:51.248 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:51 +0000 (0:00:00.071) 0:00:21.979 ******** 2020-10-05T11:50:51.285 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-10-05T11:50:51.286 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:51.318 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:51 +0000 (0:00:00.070) 0:00:22.049 ******** 2020-10-05T11:50:51.344 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-10-05T11:50:51.346 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-05T11:50:51.380 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:51 +0000 (0:00:00.062) 0:00:22.111 ******** 2020-10-05T11:50:51.417 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-10-05T11:50:51.419 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"cache_update_time": 1601898622, "cache_updated": false, "changed": false} TASK [common : Install nrpe without epel] ************************************** skipping: [smithi158.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:51.453 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:51 +0000 (0:00:00.073) 0:00:22.184 ******** 2020-10-05T11:50:51.460 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:51.461 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:51.498 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:51 +0000 (0:00:00.044) 0:00:22.228 ******** 2020-10-05T11:50:51.538 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-10-05T11:50:51.540 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:51.572 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:51 +0000 (0:00:00.074) 0:00:22.303 ******** 2020-10-05T11:50:51.766 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-10-05T11:50:51.768 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-10-05T11:50:51.802 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:51 +0000 (0:00:00.229) 0:00:22.532 ******** 2020-10-05T11:50:52.148 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-10-05T11:50:52.150 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-10-05T11:50:52.183 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:52 +0000 (0:00:00.380) 0:00:22.913 ******** 2020-10-05T11:50:52.324 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-10-05T11:50:52.326 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-10-05T11:50:52.428 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-10-05T11:50:52.463 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:52 +0000 (0:00:00.280) 0:00:23.194 ******** 2020-10-05T11:50:52.470 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-10-05T11:50:52.472 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1601898617, "cache_updated": false, "changed": false} 2020-10-05T11:50:52.509 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:52 +0000 (0:00:00.045) 0:00:23.240 ******** 2020-10-05T11:50:52.515 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-10-05T11:50:52.517 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:52.552 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:52 +0000 (0:00:00.042) 0:00:23.283 ******** 2020-10-05T11:50:52.581 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-10-05T11:50:52.582 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-05T11:50:52.615 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:52 +0000 (0:00:00.063) 0:00:23.346 ******** 2020-10-05T11:50:52.643 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-10-05T11:50:52.645 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:52.677 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:52 +0000 (0:00:00.061) 0:00:23.408 ******** 2020-10-05T11:50:52.818 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-10-05T11:50:52.820 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-10-05T11:50:52.854 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:52 +0000 (0:00:00.176) 0:00:23.584 ******** 2020-10-05T11:50:52.995 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-10-05T11:50:52.997 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2020-10-05T11:50:53.032 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:53 +0000 (0:00:00.178) 0:00:23.763 ******** 2020-10-05T11:50:53.153 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-10-05T11:50:53.155 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-10-05T11:50:53.189 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:53 +0000 (0:00:00.156) 0:00:23.920 ******** 2020-10-05T11:50:53.330 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-10-05T11:50:53.332 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-10-05T11:50:53.435 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-10-05T11:50:53.470 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:53 +0000 (0:00:00.281) 0:00:24.201 ******** 2020-10-05T11:50:53.497 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-10-05T11:50:53.499 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:53.532 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:53 +0000 (0:00:00.062) 0:00:24.263 ******** 2020-10-05T11:50:53.569 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-10-05T11:50:53.571 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-05T11:50:53.608 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:53 +0000 (0:00:00.075) 0:00:24.339 ******** 2020-10-05T11:50:53.626 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-10-05T11:50:53.627 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-10-05 11:49:16 UTC", "ActiveEnterTimestampMonotonic": "17794868", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service systemd-journald.socket sysinit.target time-sync.target remote-fs.target basic.target -.mount local-fs.target system.slice nss-lookup.target network.target var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-10-05 11:49:16 UTC", "AssertTimestampMonotonic": "17793910", "Before": "xdm.service getty@tty1.service shutdown.target multi-user.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-10-05 11:49:16 UTC", "ConditionTimestampMonotonic": "17793910", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-10-05T11:50:53.629 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1299", "ExecMainStartTimestamp": "Mon 2020-10-05 11:49:16 UTC", "ExecMainStartTimestampMonotonic": "17794828", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-10-05 11:49:16 UTC", "InactiveExitTimestampMonotonic": "17794868", "InvocationID": "8b010740c0c34c9c86098a3123d4bf7e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "i 2020-10-05T11:50:53.630 INFO:teuthology.task.ansible.out:nfinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1299", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no" 2020-10-05T11:50:53.631 INFO:teuthology.task.ansible.out:, "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-10-05 11:49:16 UTC", "StateChangeTimestampMonotonic": "17794868", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-10-05 11:49:16 UTC", "WatchdogTimestampMonotonic": "17794867", "WatchdogUSec": "0"}} 2020-10-05T11:50:53.662 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:53 +0000 (0:00:00.053) 0:00:24.393 ******** 2020-10-05T11:50:53.669 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-10-05T11:50:53.670 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:53.707 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:53 +0000 (0:00:00.044) 0:00:24.437 ******** 2020-10-05T11:50:53.712 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-10-05T11:50:53.714 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:53.748 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:53 +0000 (0:00:00.041) 0:00:24.479 ******** 2020-10-05T11:50:53.774 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:53.808 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:53 +0000 (0:00:00.059) 0:00:24.539 ******** 2020-10-05T11:50:53.835 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:53.869 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:53 +0000 (0:00:00.060) 0:00:24.600 ******** 2020-10-05T11:50:53.896 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-10-05T11:50:53.898 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:53.930 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:53 +0000 (0:00:00.061) 0:00:24.661 ******** 2020-10-05T11:50:53.957 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-10-05T11:50:53.959 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:53.991 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:53 +0000 (0:00:00.060) 0:00:24.722 ******** 2020-10-05T11:50:54.018 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:54.020 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2020-10-05T11:50:54.053 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.061) 0:00:24.784 ******** 2020-10-05T11:50:54.084 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.031) 0:00:24.815 ******** 2020-10-05T11:50:54.091 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-10-05T11:50:54.092 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:54.127 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.042) 0:00:24.858 ******** 2020-10-05T11:50:54.155 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-10-05T11:50:54.157 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:54.189 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.062) 0:00:24.920 ******** 2020-10-05T11:50:54.217 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-10-05T11:50:54.219 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:54.251 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.061) 0:00:24.982 ******** 2020-10-05T11:50:54.278 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-10-05T11:50:54.280 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:54.312 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.060) 0:00:25.043 ******** 2020-10-05T11:50:54.318 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-10-05T11:50:54.320 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-10-05 11:49:37 UTC", "ActiveEnterTimestampMonotonic": "18157010", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target network.target time-sync.target var-run.mount nss-lookup.target remote-fs.target systemd-tmpfiles-setup.service sysinit.target system.slice systemd-journald.socket -.mount local-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-10-05 11:49:37 UTC", "AssertTimestampMonotonic": "18155550", "Before": "getty@tty1.service plymouth-quit.service multi-user.target shutdown.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-10-05 11:49:37 UTC", "ConditionTimestampMonotonic": "18155550", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-10-05T11:50:54.321 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1132", "ExecMainStartTimestamp": "Mon 2020-10-05 11:49:37 UTC", "ExecMainStartTimestampMonotonic": "18156977", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-10-05 11:49:37 UTC", "InactiveExitTimestampMonotonic": "18157010", "InvocationID": "558a70c9610a4bd6a56c4459b1fd136f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "i 2020-10-05T11:50:54.323 INFO:teuthology.task.ansible.out:nfinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1132", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no" 2020-10-05T11:50:54.324 INFO:teuthology.task.ansible.out:, "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-10-05 11:49:37 UTC", "StateChangeTimestampMonotonic": "18157010", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-10-05 11:49:37 UTC", "WatchdogTimestampMonotonic": "18157009", "WatchdogUSec": "0"}} 2020-10-05T11:50:54.355 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.043) 0:00:25.086 ******** 2020-10-05T11:50:54.362 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-10-05T11:50:54.363 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-10-05T11:50:54.400 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.045) 0:00:25.131 ******** 2020-10-05T11:50:54.407 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-10-05T11:50:54.409 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:54.443 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.042) 0:00:25.174 ******** 2020-10-05T11:50:54.449 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-10-05T11:50:54.449 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-10-05T11:50:54.485 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.042) 0:00:25.216 ******** 2020-10-05T11:50:54.491 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-10-05T11:50:54.493 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:54.526 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.041) 0:00:25.257 ******** 2020-10-05T11:50:54.533 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-10-05T11:50:54.534 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-10-05T11:50:54.568 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.041) 0:00:25.299 ******** 2020-10-05T11:50:54.575 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-10-05T11:50:54.577 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:54.610 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.041) 0:00:25.341 ******** 2020-10-05T11:50:54.617 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-10-05T11:50:54.618 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-10-05T11:50:54.651 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.041) 0:00:25.382 ******** 2020-10-05T11:50:54.659 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-10-05T11:50:54.660 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:54.694 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.042) 0:00:25.425 ******** 2020-10-05T11:50:54.722 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-10-05T11:50:54.724 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:54.756 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.061) 0:00:25.487 ******** 2020-10-05T11:50:54.773 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-10-05T11:50:54.775 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-10-05T11:50:54.807 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.051) 0:00:25.538 ******** 2020-10-05T11:50:54.814 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-10-05T11:50:54.816 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:54.849 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.041) 0:00:25.580 ******** 2020-10-05T11:50:54.877 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-10-05T11:50:54.879 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:54.911 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.061) 0:00:25.642 ******** 2020-10-05T11:50:54.937 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-10-05T11:50:54.939 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "gid": 1230, "name": "ubuntu", "state": "present", "system": false} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:54.972 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:54 +0000 (0:00:00.061) 0:00:25.703 ******** 2020-10-05T11:50:55.009 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.036) 0:00:25.740 ******** 2020-10-05T11:50:55.015 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-10-05T11:50:55.016 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:55.051 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.042) 0:00:25.782 ******** 2020-10-05T11:50:55.058 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-10-05T11:50:55.059 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:55.093 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.042) 0:00:25.824 ******** 2020-10-05T11:50:55.100 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-10-05T11:50:55.102 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:55.136 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.042) 0:00:25.867 ******** 2020-10-05T11:50:55.143 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-10-05T11:50:55.144 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:55.179 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.042) 0:00:25.910 ******** 2020-10-05T11:50:55.206 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-10-05T11:50:55.208 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-10-05T11:50:55.241 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.061) 0:00:25.971 ******** 2020-10-05T11:50:55.278 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-10-05T11:50:55.280 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-10-05T11:50:55.313 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.072) 0:00:26.044 ******** 2020-10-05T11:50:55.320 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-10-05T11:50:55.321 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-10-05T11:50:55.356 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.043) 0:00:26.087 ******** 2020-10-05T11:50:55.363 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-10-05T11:50:55.365 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-10-05T11:50:55.399 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.042) 0:00:26.130 ******** 2020-10-05T11:50:55.436 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-10-05T11:50:55.438 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-10-05T11:50:55.471 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.071) 0:00:26.202 ******** 2020-10-05T11:50:55.601 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-10-05T11:50:55.642 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.171) 0:00:26.373 ******** 2020-10-05T11:50:55.731 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-10-05T11:50:55.733 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-10-05T11:50:55.767 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.125) 0:00:26.498 ******** 2020-10-05T11:50:55.774 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-10-05T11:50:55.775 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 1230, "name": "ubuntu", "state": "present", "system": false} 2020-10-05T11:50:55.809 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.041) 0:00:26.540 ******** 2020-10-05T11:50:55.815 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-10-05T11:50:55.817 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi081"}, "changed": false} 2020-10-05T11:50:55.854 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.045) 0:00:26.585 ******** 2020-10-05T11:50:55.861 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-10-05T11:50:55.863 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:55.896 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.042) 0:00:26.627 ******** 2020-10-05T11:50:55.923 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-10-05T11:50:55.924 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:55.957 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:55 +0000 (0:00:00.060) 0:00:26.688 ******** 2020-10-05T11:50:56.109 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-10-05T11:50:56.110 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-10-05T11:50:56.144 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:56 +0000 (0:00:00.187) 0:00:26.875 ******** 2020-10-05T11:50:56.513 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-10-05T11:50:56.515 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-10-05T11:50:56.549 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:56 +0000 (0:00:00.404) 0:00:27.280 ******** 2020-10-05T11:50:56.577 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-10-05T11:50:56.579 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi158"}, "changed": false} 2020-10-05T11:50:56.612 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:56 +0000 (0:00:00.063) 0:00:27.343 ******** 2020-10-05T11:50:56.765 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-10-05T11:50:56.766 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi081", "ansible_hostname": "smithi081", "ansible_nodename": "smithi081"}, "changed": false, "name": "smithi081"} 2020-10-05T11:50:56.801 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:56 +0000 (0:00:00.188) 0:00:27.532 ******** 2020-10-05T11:50:57.038 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi158", "ansible_hostname": "smithi158", "ansible_nodename": "smithi158"}, "changed": false, "name": "smithi158"} 2020-10-05T11:50:57.073 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:57 +0000 (0:00:00.271) 0:00:27.803 ******** 2020-10-05T11:50:57.120 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-10-05T11:50:57.121 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-10-05T11:50:57.155 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:57 +0000 (0:00:00.082) 0:00:27.886 ******** 2020-10-05T11:50:57.391 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-10-05T11:50:57.444 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:57 +0000 (0:00:00.287) 0:00:28.174 ******** 2020-10-05T11:50:57.473 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-10-05T11:50:57.475 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-10-05T11:50:57.508 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:57 +0000 (0:00:00.064) 0:00:28.239 ******** 2020-10-05T11:50:57.763 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-10-05T11:50:57.798 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:57 +0000 (0:00:00.289) 0:00:28.529 ******** 2020-10-05T11:50:58.012 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-10-05T11:50:58.014 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-10-05T11:50:58.049 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.251) 0:00:28.780 ******** 2020-10-05T11:50:58.078 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.111 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.062) 0:00:28.842 ******** 2020-10-05T11:50:58.139 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-10-05T11:50:58.141 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.174 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.062) 0:00:28.905 ******** 2020-10-05T11:50:58.201 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-10-05T11:50:58.202 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.235 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.060) 0:00:28.966 ******** 2020-10-05T11:50:58.261 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-10-05T11:50:58.262 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.295 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.059) 0:00:29.025 ******** 2020-10-05T11:50:58.311 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-10-05T11:50:58.313 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-10-05T11:50:58.345 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.050) 0:00:29.076 ******** 2020-10-05T11:50:58.353 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-10-05T11:50:58.354 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.391 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.045) 0:00:29.122 ******** 2020-10-05T11:50:58.398 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-10-05T11:50:58.400 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.437 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.045) 0:00:29.168 ******** 2020-10-05T11:50:58.443 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-10-05T11:50:58.445 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.479 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.042) 0:00:29.210 ******** 2020-10-05T11:50:58.486 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-10-05T11:50:58.487 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.525 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.045) 0:00:29.256 ******** 2020-10-05T11:50:58.532 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.567 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.041) 0:00:29.298 ******** 2020-10-05T11:50:58.573 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-10-05T11:50:58.574 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.609 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.041) 0:00:29.340 ******** 2020-10-05T11:50:58.615 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-10-05T11:50:58.617 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.651 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.042) 0:00:29.382 ******** 2020-10-05T11:50:58.658 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-10-05T11:50:58.660 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.693 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.041) 0:00:29.424 ******** 2020-10-05T11:50:58.701 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-10-05T11:50:58.735 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.042) 0:00:29.466 ******** 2020-10-05T11:50:58.742 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-10-05T11:50:58.744 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.777 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.041) 0:00:29.508 ******** 2020-10-05T11:50:58.784 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-10-05T11:50:58.820 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.041) 0:00:29.550 ******** 2020-10-05T11:50:58.826 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-10-05T11:50:58.828 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.861 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.041) 0:00:29.592 ******** 2020-10-05T11:50:58.867 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-10-05T11:50:58.903 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.042) 0:00:29.634 ******** 2020-10-05T11:50:58.910 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-10-05T11:50:58.911 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.945 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.041) 0:00:29.675 ******** 2020-10-05T11:50:58.952 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-10-05T11:50:58.954 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:58.987 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:58 +0000 (0:00:00.042) 0:00:29.718 ******** 2020-10-05T11:50:58.994 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-10-05T11:50:58.995 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.030 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.043) 0:00:29.761 ******** 2020-10-05T11:50:59.036 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-10-05T11:50:59.038 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.073 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.042) 0:00:29.804 ******** 2020-10-05T11:50:59.080 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-10-05T11:50:59.118 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.045) 0:00:29.849 ******** 2020-10-05T11:50:59.124 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-10-05T11:50:59.126 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.160 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.041) 0:00:29.891 ******** 2020-10-05T11:50:59.169 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-10-05T11:50:59.205 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.044) 0:00:29.935 ******** 2020-10-05T11:50:59.211 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-05T11:50:59.213 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.246 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.041) 0:00:29.977 ******** 2020-10-05T11:50:59.253 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-10-05T11:50:59.288 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.041) 0:00:30.019 ******** 2020-10-05T11:50:59.295 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-10-05T11:50:59.296 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.330 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.042) 0:00:30.061 ******** 2020-10-05T11:50:59.337 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-10-05T11:50:59.339 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.372 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.042) 0:00:30.103 ******** 2020-10-05T11:50:59.379 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-10-05T11:50:59.381 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.415 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.042) 0:00:30.146 ******** 2020-10-05T11:50:59.422 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-10-05T11:50:59.424 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.458 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.042) 0:00:30.189 ******** 2020-10-05T11:50:59.464 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-10-05T11:50:59.466 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.499 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.041) 0:00:30.230 ******** 2020-10-05T11:50:59.506 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-10-05T11:50:59.507 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.541 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.041) 0:00:30.272 ******** 2020-10-05T11:50:59.547 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-10-05T11:50:59.549 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.582 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.040) 0:00:30.313 ******** 2020-10-05T11:50:59.588 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-05T11:50:59.590 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.622 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.040) 0:00:30.353 ******** 2020-10-05T11:50:59.628 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-10-05T11:50:59.630 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.663 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.041) 0:00:30.394 ******** 2020-10-05T11:50:59.671 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-10-05T11:50:59.673 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.705 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.041) 0:00:30.436 ******** 2020-10-05T11:50:59.711 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-10-05T11:50:59.713 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.750 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.044) 0:00:30.481 ******** 2020-10-05T11:50:59.756 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-10-05T11:50:59.758 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.790 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.040) 0:00:30.521 ******** 2020-10-05T11:50:59.795 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-10-05T11:50:59.911 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.943 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.153) 0:00:30.674 ******** 2020-10-05T11:50:59.950 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-10-05T11:50:59.951 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:50:59.983 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:50:59 +0000 (0:00:00.039) 0:00:30.714 ******** 2020-10-05T11:50:59.990 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-10-05T11:50:59.991 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.024 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.040) 0:00:30.754 ******** 2020-10-05T11:51:00.029 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-10-05T11:51:00.031 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.064 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.040) 0:00:30.795 ******** 2020-10-05T11:51:00.069 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-10-05T11:51:00.071 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.104 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.040) 0:00:30.835 ******** 2020-10-05T11:51:00.111 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-10-05T11:51:00.112 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.146 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.041) 0:00:30.877 ******** 2020-10-05T11:51:00.152 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-10-05T11:51:00.153 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.188 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.042) 0:00:30.919 ******** 2020-10-05T11:51:00.194 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-10-05T11:51:00.196 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.229 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.040) 0:00:30.960 ******** 2020-10-05T11:51:00.235 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-10-05T11:51:00.237 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.270 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.040) 0:00:31.001 ******** 2020-10-05T11:51:00.276 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-10-05T11:51:00.278 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.311 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.040) 0:00:31.042 ******** 2020-10-05T11:51:00.318 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-10-05T11:51:00.320 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.352 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.041) 0:00:31.083 ******** 2020-10-05T11:51:00.358 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-10-05T11:51:00.359 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.392 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.040) 0:00:31.123 ******** 2020-10-05T11:51:00.398 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-10-05T11:51:00.399 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.433 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.040) 0:00:31.163 ******** 2020-10-05T11:51:00.439 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-10-05T11:51:00.441 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.477 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.043) 0:00:31.207 ******** 2020-10-05T11:51:00.483 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-10-05T11:51:00.484 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.518 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.040) 0:00:31.248 ******** 2020-10-05T11:51:00.524 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-10-05T11:51:00.526 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.558 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.040) 0:00:31.289 ******** 2020-10-05T11:51:00.563 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-10-05T11:51:00.565 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.598 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.040) 0:00:31.329 ******** 2020-10-05T11:51:00.604 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-10-05T11:51:00.606 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.638 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.039) 0:00:31.369 ******** 2020-10-05T11:51:00.644 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-10-05T11:51:00.646 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.679 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.041) 0:00:31.410 ******** 2020-10-05T11:51:00.686 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-10-05T11:51:00.688 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.721 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.041) 0:00:31.452 ******** 2020-10-05T11:51:00.728 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-10-05T11:51:00.729 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.764 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.043) 0:00:31.495 ******** 2020-10-05T11:51:00.771 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-10-05T11:51:00.773 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.807 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.043) 0:00:31.538 ******** 2020-10-05T11:51:00.814 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-10-05T11:51:00.815 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.850 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.042) 0:00:31.580 ******** 2020-10-05T11:51:00.856 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-10-05T11:51:00.858 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.891 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.041) 0:00:31.622 ******** 2020-10-05T11:51:00.917 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-10-05T11:51:00.919 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:00.951 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:00 +0000 (0:00:00.059) 0:00:31.682 ******** 2020-10-05T11:51:00.977 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-10-05T11:51:00.978 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for custom repos] *************************************** ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005211", "end": "2020-10-05 11:51:00.868991", "rc": 0, "start": "2020-10-05 11:51:00.863780", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:01.012 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:01 +0000 (0:00:00.060) 0:00:31.743 ******** 2020-10-05T11:51:01.043 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:01 +0000 (0:00:00.031) 0:00:31.774 ******** 2020-10-05T11:51:01.048 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-10-05T11:51:01.086 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:01 +0000 (0:00:00.043) 0:00:31.817 ******** 2020-10-05T11:51:01.093 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-10-05T11:51:01.094 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:01.129 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:01 +0000 (0:00:00.042) 0:00:31.859 ******** 2020-10-05T11:51:01.156 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-10-05T11:51:01.157 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:01.189 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:01 +0000 (0:00:00.060) 0:00:31.920 ******** 2020-10-05T11:51:01.330 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-10-05T11:51:01.332 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005147", "end": "2020-10-05 11:51:01.054069", "rc": 0, "start": "2020-10-05 11:51:01.048922", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:01.365 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:01 +0000 (0:00:00.176) 0:00:32.096 ******** 2020-10-05T11:51:01.391 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-10-05T11:51:01.392 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-10-05T11:51:01.393 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-10-05T11:51:01.427 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:01 +0000 (0:00:00.061) 0:00:32.158 ******** 2020-10-05T11:51:01.458 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:01 +0000 (0:00:00.031) 0:00:32.189 ******** 2020-10-05T11:51:01.465 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-10-05T11:51:01.466 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:01.500 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:01 +0000 (0:00:00.041) 0:00:32.231 ******** 2020-10-05T11:51:01.778 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-10-05T11:51:01.779 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-10-05T11:51:01.814 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:01 +0000 (0:00:00.314) 0:00:32.545 ******** 2020-10-05T11:51:01.840 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-10-05T11:51:01.842 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:01.874 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:01 +0000 (0:00:00.060) 0:00:32.605 ******** 2020-10-05T11:51:02.625 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-10-05T11:51:02.627 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-10-05T11:51:02.874 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-10-05T11:51:03.560 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-10-05T11:51:03.596 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:03 +0000 (0:00:01.721) 0:00:34.327 ******** 2020-10-05T11:51:03.771 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-10-05T11:51:03.818 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:03 +0000 (0:00:00.222) 0:00:34.549 ******** 2020-10-05T11:51:04.483 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-10-05T11:51:04.484 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"cache_update_time": 1601898622, "cache_updated": false, "changed": false} 2020-10-05T11:51:04.518 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:04 +0000 (0:00:00.699) 0:00:35.249 ******** 2020-10-05T11:51:04.545 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-10-05T11:51:04.579 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:04 +0000 (0:00:00.061) 0:00:35.310 ******** 2020-10-05T11:51:04.751 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-10-05T11:51:04.752 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi081.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.037782", "end": "2020-10-05 11:51:04.631257", "rc": 0, "start": "2020-10-05 11:51:04.593475", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:04.786 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:04 +0000 (0:00:00.206) 0:00:35.517 ******** 2020-10-05T11:51:04.793 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-10-05T11:51:04.794 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1601898617, "cache_updated": false, "changed": false} 2020-10-05T11:51:04.828 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:04 +0000 (0:00:00.042) 0:00:35.559 ******** 2020-10-05T11:51:04.855 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-10-05T11:51:04.888 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:04 +0000 (0:00:00.060) 0:00:35.619 ******** 2020-10-05T11:51:05.059 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-10-05T11:51:05.061 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.036747", "end": "2020-10-05 11:51:04.775577", "rc": 0, "start": "2020-10-05 11:51:04.738830", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:05.094 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:05 +0000 (0:00:00.205) 0:00:35.825 ******** 2020-10-05T11:51:07.587 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-10-05T11:51:07.589 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"cache_update_time": 1601898622, "cache_updated": false, "changed": false} 2020-10-05T11:51:07.622 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:07 +0000 (0:00:02.528) 0:00:38.353 ******** 2020-10-05T11:51:07.962 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1601898617, "cache_updated": false, "changed": false} 2020-10-05T11:51:07.996 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:07 +0000 (0:00:00.373) 0:00:38.727 ******** 2020-10-05T11:51:16.940 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-10-05T11:51:16.941 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 0 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 102060 files and directories 2020-10-05T11:51:16.943 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 0 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2020-10-05T11:51:16.944 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 102060 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.2) ..."]} 2020-10-05T11:51:16.975 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:16 +0000 (0:00:08.978) 0:00:47.706 ******** 2020-10-05T11:51:17.169 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 0 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 102060 files and directories 2020-10-05T11:51:17.171 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 0 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2020-10-05T11:51:17.172 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 102060 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.2) ..."]} 2020-10-05T11:51:17.204 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:17 +0000 (0:00:00.229) 0:00:47.935 ******** 2020-10-05T11:51:17.823 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-10-05T11:51:17.825 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"cache_update_time": 1601898622, "cache_updated": false, "changed": false} 2020-10-05T11:51:17.860 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:17 +0000 (0:00:00.655) 0:00:48.590 ******** 2020-10-05T11:51:17.886 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-10-05T11:51:17.888 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:17.921 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:17 +0000 (0:00:00.061) 0:00:48.652 ******** 2020-10-05T11:51:18.063 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-10-05T11:51:18.064 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1601898617, "cache_updated": false, "changed": false} 2020-10-05T11:51:18.103 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:18 +0000 (0:00:00.181) 0:00:48.833 ******** 2020-10-05T11:51:18.130 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-10-05T11:51:18.131 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:18.164 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:18 +0000 (0:00:00.061) 0:00:48.895 ******** 2020-10-05T11:51:26.593 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-10-05T11:51:26.594 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"cache_update_time": 1601898622, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.32 [40.3 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.32 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.32 [5184 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.32 [869 kB]\nFetched 10.4 MB in 1s (9656 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2020-10-05T11:51:26.595 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101918 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2020-10-05T11:51:26.597 INFO:teuthology.task.ansible.out:1.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.32 [40.3 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.32 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.32 [5184 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.32 [869 kB]", "Fetched 10.4 MB in 1s (9656 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Rea 2020-10-05T11:51:26.599 INFO:teuthology.task.ansible.out:ding database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101918 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.2) ..."]} 2020-10-05T11:51:26.632 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:26 +0000 (0:00:08.467) 0:00:57.362 ******** 2020-10-05T11:51:26.778 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1601898617, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.32 [40.3 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.32 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.32 [5184 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.32 [869 kB]\nFetched 10.4 MB in 1s (9835 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2020-10-05T11:51:26.780 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101918 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2020-10-05T11:51:26.782 INFO:teuthology.task.ansible.out:1.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.32 [40.3 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.32 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.32 [5184 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.32 [869 kB]", "Fetched 10.4 MB in 1s (9835 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Rea 2020-10-05T11:51:26.783 INFO:teuthology.task.ansible.out:ding database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101918 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.2) ..."]} 2020-10-05T11:51:26.825 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:26 +0000 (0:00:00.193) 0:00:57.556 ******** 2020-10-05T11:51:27.482 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-10-05T11:51:27.484 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"cache_update_time": 1601898622, "cache_updated": false, "changed": false} 2020-10-05T11:51:27.518 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:27 +0000 (0:00:00.692) 0:00:58.249 ******** 2020-10-05T11:51:27.638 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-10-05T11:51:27.640 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-10-05T11:51:27.674 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:27 +0000 (0:00:00.156) 0:00:58.405 ******** 2020-10-05T11:51:27.681 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-10-05T11:51:27.682 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1601898617, "cache_updated": false, "changed": false} 2020-10-05T11:51:27.717 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:27 +0000 (0:00:00.042) 0:00:58.448 ******** 2020-10-05T11:51:27.723 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-10-05T11:51:27.724 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:27.762 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:27 +0000 (0:00:00.044) 0:00:58.492 ******** 2020-10-05T11:51:27.842 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-10-05T11:51:27.844 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-10-05T11:51:27.881 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:27 +0000 (0:00:00.119) 0:00:58.612 ******** 2020-10-05T11:51:27.898 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-10-05T11:51:27.900 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-10-05T11:51:27.933 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:27 +0000 (0:00:00.051) 0:00:58.664 ******** 2020-10-05T11:51:27.939 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-10-05T11:51:27.941 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:27.975 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:27 +0000 (0:00:00.041) 0:00:58.705 ******** 2020-10-05T11:51:28.094 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-10-05T11:51:28.096 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-10-05T11:51:28.129 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:28 +0000 (0:00:00.154) 0:00:58.860 ******** 2020-10-05T11:51:28.241 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-10-05T11:51:28.243 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-10-05T11:51:28.277 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:28 +0000 (0:00:00.148) 0:00:59.008 ******** 2020-10-05T11:51:28.431 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-10-05T11:51:28.433 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1230, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-10-05T11:51:28.468 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:28 +0000 (0:00:00.190) 0:00:59.198 ******** 2020-10-05T11:51:28.475 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-10-05T11:51:28.476 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-10-05T11:51:28.511 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:28 +0000 (0:00:00.043) 0:00:59.242 ******** 2020-10-05T11:51:28.592 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-10-05T11:51:28.594 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-05T11:51:28.629 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:28 +0000 (0:00:00.117) 0:00:59.360 ******** 2020-10-05T11:51:28.668 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-10-05T11:51:28.670 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1230, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-10-05T11:51:28.704 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:28 +0000 (0:00:00.075) 0:00:59.435 ******** 2020-10-05T11:51:28.835 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-10-05T11:51:28.837 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-05T11:51:28.874 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:28 +0000 (0:00:00.170) 0:00:59.605 ******** 2020-10-05T11:51:28.922 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-10-05T11:51:28.924 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2020-10-05 11:49:16 UTC", "ActiveEnterTimestampMonotonic": "18241891", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount network.target remote-fs.target system.slice sysinit.target systemd-journald.socket nss-lookup.target basic.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-10-05 11:49:16 UTC", "AssertTimestampMonotonic": "17793003", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-10-05 11:49:16 UTC", "ConditionTimestampMonotonic": "17793003", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-10-05T11:51:28.925 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1372", "ExecMainStartTimestamp": "Mon 2020-10-05 11:49:16 UTC", "ExecMainStartTimestampMonotonic": "18241880", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-10-05 11:49:16 UTC", "InactiveExitTimestampMonotonic": "17793857", "InvocationID": "8b56d918a2354c979fe622b4fba7a63c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-10-05T11:51:28.927 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1372", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2020-10-05T11:51:28.928 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-10-05 11:49:16 UTC", "StateChangeTimestampMonotonic": "18241891", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-10-05 11:49:16 UTC", "WatchdogTimestampMonotonic": "18241890", "WatchdogUSec": "0"}} 2020-10-05T11:51:28.960 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:28 +0000 (0:00:00.085) 0:00:59.691 ******** 2020-10-05T11:51:28.987 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-10-05T11:51:28.989 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.020 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.060) 0:00:59.751 ******** 2020-10-05T11:51:29.049 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-10-05T11:51:29.051 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.082 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.061) 0:00:59.813 ******** 2020-10-05T11:51:29.111 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.153 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.071) 0:00:59.884 ******** 2020-10-05T11:51:29.172 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-10-05T11:51:29.173 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2020-10-05 11:49:38 UTC", "ActiveEnterTimestampMonotonic": "18626305", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service remote-fs.target system.slice basic.target systemd-journald.socket network.target nss-lookup.target sysinit.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-10-05 11:49:37 UTC", "AssertTimestampMonotonic": "18152437", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-10-05 11:49:37 UTC", "ConditionTimestampMonotonic": "18152437", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-10-05T11:51:29.175 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1187", "ExecMainStartTimestamp": "Mon 2020-10-05 11:49:38 UTC", "ExecMainStartTimestampMonotonic": "18626293", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-10-05 11:49:37 UTC", "InactiveExitTimestampMonotonic": "18153073", "InvocationID": "7c57cc55f26a4d52b401243df459d426", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-10-05T11:51:29.177 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1187", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2020-10-05T11:51:29.178 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-10-05 11:49:38 UTC", "StateChangeTimestampMonotonic": "18626305", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-10-05 11:49:38 UTC", "WatchdogTimestampMonotonic": "18626304", "WatchdogUSec": "0"}} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.211 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.057) 0:00:59.941 ******** 2020-10-05T11:51:29.247 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.036) 0:00:59.978 ******** 2020-10-05T11:51:29.254 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-10-05T11:51:29.256 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.289 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.042) 0:01:00.020 ******** 2020-10-05T11:51:29.297 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-10-05T11:51:29.299 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.332 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.042) 0:01:00.063 ******** 2020-10-05T11:51:29.339 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-10-05T11:51:29.340 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.375 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.042) 0:01:00.105 ******** 2020-10-05T11:51:29.381 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-10-05T11:51:29.383 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.417 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.042) 0:01:00.147 ******** 2020-10-05T11:51:29.423 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-10-05T11:51:29.425 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.459 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.042) 0:01:00.190 ******** 2020-10-05T11:51:29.466 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-10-05T11:51:29.468 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.502 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.042) 0:01:00.232 ******** 2020-10-05T11:51:29.508 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-10-05T11:51:29.510 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.547 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.045) 0:01:00.278 ******** 2020-10-05T11:51:29.554 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-10-05T11:51:29.556 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.595 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.047) 0:01:00.326 ******** 2020-10-05T11:51:29.603 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-05T11:51:29.605 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.642 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.046) 0:01:00.372 ******** 2020-10-05T11:51:29.648 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-10-05T11:51:29.650 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.684 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.042) 0:01:00.415 ******** 2020-10-05T11:51:29.690 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-10-05T11:51:29.692 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.726 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.042) 0:01:00.457 ******** 2020-10-05T11:51:29.733 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-10-05T11:51:29.735 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.769 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.042) 0:01:00.500 ******** 2020-10-05T11:51:29.776 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-10-05T11:51:29.777 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.814 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.044) 0:01:00.544 ******** 2020-10-05T11:51:29.822 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-10-05T11:51:29.824 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.857 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.043) 0:01:00.588 ******** 2020-10-05T11:51:29.864 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-10-05T11:51:29.866 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.905 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.047) 0:01:00.635 ******** 2020-10-05T11:51:29.911 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-10-05T11:51:29.913 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.946 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.041) 0:01:00.677 ******** 2020-10-05T11:51:29.953 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-10-05T11:51:29.954 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:29.988 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:29 +0000 (0:00:00.041) 0:01:00.719 ******** 2020-10-05T11:51:29.995 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-05T11:51:29.997 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.029 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.041) 0:01:00.760 ******** 2020-10-05T11:51:30.036 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-10-05T11:51:30.038 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.071 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.041) 0:01:00.802 ******** 2020-10-05T11:51:30.078 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-10-05T11:51:30.080 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.113 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.041) 0:01:00.843 ******** 2020-10-05T11:51:30.120 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-10-05T11:51:30.122 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.155 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.042) 0:01:00.886 ******** 2020-10-05T11:51:30.162 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-10-05T11:51:30.164 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.201 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.045) 0:01:00.931 ******** 2020-10-05T11:51:30.207 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-10-05T11:51:30.209 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.244 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.043) 0:01:00.975 ******** 2020-10-05T11:51:30.252 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-10-05T11:51:30.254 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.288 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.043) 0:01:01.019 ******** 2020-10-05T11:51:30.295 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-10-05T11:51:30.296 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.331 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.043) 0:01:01.062 ******** 2020-10-05T11:51:30.338 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-10-05T11:51:30.339 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.373 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.042) 0:01:01.104 ******** 2020-10-05T11:51:30.379 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-10-05T11:51:30.381 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.415 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.042) 0:01:01.146 ******** 2020-10-05T11:51:30.422 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-10-05T11:51:30.424 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.458 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.043) 0:01:01.189 ******** 2020-10-05T11:51:30.468 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-10-05T11:51:30.470 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.507 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.048) 0:01:01.238 ******** 2020-10-05T11:51:30.514 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-10-05T11:51:30.516 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.558 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.050) 0:01:01.288 ******** 2020-10-05T11:51:30.567 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-10-05T11:51:30.568 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.605 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.047) 0:01:01.335 ******** 2020-10-05T11:51:30.616 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-10-05T11:51:30.618 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.654 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.049) 0:01:01.385 ******** 2020-10-05T11:51:30.664 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-10-05T11:51:30.665 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.706 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.051) 0:01:01.437 ******** 2020-10-05T11:51:30.714 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-10-05T11:51:30.715 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.750 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.044) 0:01:01.481 ******** 2020-10-05T11:51:30.757 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-10-05T11:51:30.759 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.811 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.060) 0:01:01.542 ******** 2020-10-05T11:51:30.818 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-10-05T11:51:30.820 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.854 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.042) 0:01:01.585 ******** 2020-10-05T11:51:30.867 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-10-05T11:51:30.869 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.902 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.048) 0:01:01.633 ******** 2020-10-05T11:51:30.909 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-10-05T11:51:30.911 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.944 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.042) 0:01:01.675 ******** 2020-10-05T11:51:30.951 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:30.986 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:30 +0000 (0:00:00.041) 0:01:01.717 ******** 2020-10-05T11:51:30.993 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-10-05T11:51:30.994 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:31.027 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:31 +0000 (0:00:00.041) 0:01:01.758 ******** 2020-10-05T11:51:31.033 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-10-05T11:51:31.035 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:31.069 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:31 +0000 (0:00:00.041) 0:01:01.800 ******** 2020-10-05T11:51:31.075 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-10-05T11:51:31.077 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:31.111 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:31 +0000 (0:00:00.042) 0:01:01.842 ******** 2020-10-05T11:51:31.119 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-10-05T11:51:31.121 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:31.154 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:31 +0000 (0:00:00.042) 0:01:01.885 ******** 2020-10-05T11:51:31.161 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-10-05T11:51:31.163 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:31.198 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:31 +0000 (0:00:00.044) 0:01:01.929 ******** 2020-10-05T11:51:31.226 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-10-05T11:51:31.227 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:31.260 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:31 +0000 (0:00:00.061) 0:01:01.991 ******** 2020-10-05T11:51:31.287 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-10-05T11:51:31.289 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-10-05T11:51:31.322 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:31 +0000 (0:00:00.062) 0:01:02.053 ******** 2020-10-05T11:51:31.356 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:31 +0000 (0:00:00.033) 0:01:02.087 ******** 2020-10-05T11:51:31.384 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-10-05T11:51:31.385 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:31.419 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:31 +0000 (0:00:00.062) 0:01:02.150 ******** 2020-10-05T11:51:31.446 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-10-05T11:51:31.448 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:31.482 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:31 +0000 (0:00:00.062) 0:01:02.212 ******** 2020-10-05T11:51:31.605 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-10-05T11:51:31.607 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-10-05T11:51:31.645 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:31 +0000 (0:00:00.163) 0:01:02.376 ******** 2020-10-05T11:51:31.652 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-10-05T11:51:31.654 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-10-05T11:51:31.690 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:31 +0000 (0:00:00.044) 0:01:02.421 ******** 2020-10-05T11:51:31.717 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-10-05T11:51:31.719 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:31.754 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:31 +0000 (0:00:00.063) 0:01:02.485 ******** 2020-10-05T11:51:31.962 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-10-05T11:51:31.963 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-10-05T11:51:31.999 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:31 +0000 (0:00:00.245) 0:01:02.730 ******** 2020-10-05T11:51:32.027 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-10-05T11:51:32.029 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:32.062 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:32 +0000 (0:00:00.062) 0:01:02.793 ******** 2020-10-05T11:51:32.092 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-10-05T11:51:32.093 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-10-05T11:51:32.138 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:32 +0000 (0:00:00.076) 0:01:02.869 ******** 2020-10-05T11:51:32.387 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-10-05T11:51:32.423 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:32 +0000 (0:00:00.284) 0:01:03.153 ******** 2020-10-05T11:51:32.451 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-10-05T11:51:32.453 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-10-05T11:51:32.489 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:32 +0000 (0:00:00.066) 0:01:03.220 ******** 2020-10-05T11:51:32.726 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-10-05T11:51:32.762 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:32 +0000 (0:00:00.272) 0:01:03.493 ******** 2020-10-05T11:51:32.811 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-10-05T11:51:32.813 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-10-05T11:51:32.847 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:32 +0000 (0:00:00.085) 0:01:03.578 ******** 2020-10-05T11:51:32.978 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-10-05T11:51:32.980 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-05T11:51:33.013 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.165) 0:01:03.744 ******** 2020-10-05T11:51:33.050 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-10-05T11:51:33.052 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.089 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.075) 0:01:03.820 ******** 2020-10-05T11:51:33.095 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-10-05T11:51:33.097 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-10-05T11:51:33.132 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.042) 0:01:03.863 ******** 2020-10-05T11:51:33.138 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-10-05T11:51:33.140 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.174 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.042) 0:01:03.905 ******** 2020-10-05T11:51:33.202 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.236 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.061) 0:01:03.966 ******** 2020-10-05T11:51:33.265 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-10-05T11:51:33.266 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-05T11:51:33.299 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.063) 0:01:04.030 ******** 2020-10-05T11:51:33.332 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.032) 0:01:04.062 ******** 2020-10-05T11:51:33.337 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-10-05T11:51:33.339 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.373 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.041) 0:01:04.104 ******** 2020-10-05T11:51:33.379 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-10-05T11:51:33.381 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.415 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.041) 0:01:04.146 ******** 2020-10-05T11:51:33.421 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-05T11:51:33.423 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-10-05T11:51:33.457 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.042) 0:01:04.188 ******** 2020-10-05T11:51:33.464 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-10-05T11:51:33.465 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.499 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.042) 0:01:04.230 ******** 2020-10-05T11:51:33.506 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-10-05T11:51:33.508 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.519 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.520 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-10-05T11:51:33.522 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.561 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.062) 0:01:04.292 ******** 2020-10-05T11:51:33.569 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-10-05T11:51:33.571 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.571 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-10-05T11:51:33.572 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.572 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.573 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.584 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.586 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.623 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.061) 0:01:04.353 ******** 2020-10-05T11:51:33.631 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-10-05T11:51:33.633 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.675 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.052) 0:01:04.406 ******** 2020-10-05T11:51:33.683 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-10-05T11:51:33.685 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.722 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.046) 0:01:04.453 ******** 2020-10-05T11:51:33.749 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-05T11:51:33.751 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-10-05T11:51:33.784 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.061) 0:01:04.515 ******** 2020-10-05T11:51:33.831 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-10-05T11:51:33.833 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.843 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.844 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.854 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.855 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.865 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-10-05T11:51:33.867 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003915", "end": "2020-10-05 11:51:33.843666", "rc": 0, "start": "2020-10-05 11:51:33.839751", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi158.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.907 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.122) 0:01:04.638 ******** 2020-10-05T11:51:33.914 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-10-05T11:51:33.914 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.915 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.915 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.916 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.927 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.929 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.937 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.939 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:33.976 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:33 +0000 (0:00:00.069) 0:01:04.707 ******** 2020-10-05T11:51:33.983 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-10-05T11:51:33.984 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-10-05T11:51:34.023 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:34 +0000 (0:00:00.046) 0:01:04.754 ******** 2020-10-05T11:51:34.029 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-10-05T11:51:34.031 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:34.067 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:34 +0000 (0:00:00.044) 0:01:04.798 ******** 2020-10-05T11:51:34.094 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-10-05T11:51:34.096 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:34.131 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:34 +0000 (0:00:00.063) 0:01:04.862 ******** 2020-10-05T11:51:34.222 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi158.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003881", "end": "2020-10-05 11:51:34.201015", "rc": 0, "start": "2020-10-05 11:51:34.197134", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-10-05T11:51:34.264 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:34 +0000 (0:00:00.133) 0:01:04.995 ******** 2020-10-05T11:51:34.292 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-10-05T11:51:34.294 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:34.334 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:34 +0000 (0:00:00.069) 0:01:05.065 ******** 2020-10-05T11:51:34.361 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-10-05T11:51:34.362 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:34.398 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:34 +0000 (0:00:00.064) 0:01:05.129 ******** 2020-10-05T11:51:34.425 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-10-05T11:51:34.426 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:34.464 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:34 +0000 (0:00:00.066) 0:01:05.195 ******** 2020-10-05T11:51:35.027 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-10-05T11:51:35.029 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"cache_update_time": 1601898622, "cache_updated": false, "changed": false} 2020-10-05T11:51:35.065 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:35 +0000 (0:00:00.600) 0:01:05.796 ******** 2020-10-05T11:51:35.094 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-10-05T11:51:35.096 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:35.129 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:35 +0000 (0:00:00.064) 0:01:05.860 ******** 2020-10-05T11:51:35.179 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-10-05T11:51:35.180 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item={'block_used': 13639640, 'uuid': '2b04c511-aa55-4d14-99bd-e89e73e1b5bb', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226455468, 'size_available': 927561596928, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113890, 'block_size': 4096, 'inode_available': 60941086}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226455468, "block_size": 4096, "block_total": 240095108, "block_used": 13639640, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941086, "inode_total": 61054976, "inode_used": 113890, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927561596928, "size_total": 983429562368, "uuid": "2b04c511-aa55-4d14-99bd-e89e73e1b5bb"}} 2020-10-05T11:51:35.219 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:35 +0000 (0:00:00.089) 0:01:05.950 ******** 2020-10-05T11:51:35.351 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-10-05T11:51:35.352 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1601898617, "cache_updated": false, "changed": false} 2020-10-05T11:51:35.354 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-10-05T11:51:35.356 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009954", "end": "2020-10-05 11:51:35.242475", "rc": 0, "start": "2020-10-05 11:51:35.232521", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:35.397 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:35 +0000 (0:00:00.178) 0:01:06.128 ******** 2020-10-05T11:51:35.432 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:35 +0000 (0:00:00.034) 0:01:06.162 ******** 2020-10-05T11:51:35.439 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-10-05T11:51:35.441 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'block_used': 13639640, 'uuid': '2b04c511-aa55-4d14-99bd-e89e73e1b5bb', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226455468, 'size_available': 927561596928, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113890, 'block_size': 4096, 'inode_available': 60941086}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226455468, "block_size": 4096, "block_total": 240095108, "block_used": 13639640, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941086, "inode_total": 61054976, "inode_used": 113890, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927561596928, "size_total": 983429562368, "uuid": "2b04c511-aa55-4d14-99bd-e89e73e1b5bb"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:35.475 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:35 +0000 (0:00:00.043) 0:01:06.206 ******** 2020-10-05T11:51:35.482 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-10-05T11:51:35.484 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:35.517 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:35 +0000 (0:00:00.041) 0:01:06.248 ******** 2020-10-05T11:51:35.523 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-10-05T11:51:35.560 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:35 +0000 (0:00:00.042) 0:01:06.291 ******** 2020-10-05T11:51:35.567 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-10-05T11:51:35.569 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={'block_used': 13639631, 'uuid': '2b04c511-aa55-4d14-99bd-e89e73e1b5bb', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226455477, 'size_available': 927561633792, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113890, 'block_size': 4096, 'inode_available': 60941086}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226455477, "block_size": 4096, "block_total": 240095108, "block_used": 13639631, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941086, "inode_total": 61054976, "inode_used": 113890, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927561633792, "size_total": 983429562368, "uuid": "2b04c511-aa55-4d14-99bd-e89e73e1b5bb"}} 2020-10-05T11:51:35.603 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:35 +0000 (0:00:00.043) 0:01:06.334 ******** 2020-10-05T11:51:35.611 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-10-05T11:51:35.613 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:35.739 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-10-05T11:51:35.741 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009769", "end": "2020-10-05 11:51:35.466537", "rc": 0, "start": "2020-10-05 11:51:35.456768", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:35.775 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:35 +0000 (0:00:00.171) 0:01:06.505 ******** 2020-10-05T11:51:35.824 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi158.front.sepia.ceph.com] => (item={'block_used': 13639631, 'uuid': '2b04c511-aa55-4d14-99bd-e89e73e1b5bb', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226455477, 'size_available': 927561633792, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113890, 'block_size': 4096, 'inode_available': 60941086}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226455477, "block_size": 4096, "block_total": 240095108, "block_used": 13639631, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941086, "inode_total": 61054976, "inode_used": 113890, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927561633792, "size_total": 983429562368, "uuid": "2b04c511-aa55-4d14-99bd-e89e73e1b5bb"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:35.861 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:35 +0000 (0:00:00.086) 0:01:06.592 ******** 2020-10-05T11:51:35.887 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-10-05T11:51:35.921 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:35 +0000 (0:00:00.060) 0:01:06.652 ******** 2020-10-05T11:51:35.975 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-10-05T11:51:35.977 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:37.925 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenWchSPd80EWrXjJmViOVu0ypVT7WxGdcS'], 'uuids': ['78c4d1b1-6414-4f96-a5fb-33caa234c757']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:02.183974", "end": "2020-10-05 11:51:37.798903", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenWchSPd80EWrXjJmViOVu0ypVT7WxGdcS"], "labels": [], "masters": [], "uuids": ["78c4d1b1-6414-4f96-a5fb-33caa234c757"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:35.614929", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-05T11:51:37.927 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:37.940 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:38.173 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4B8YiTLcEP8tr6fsum1k8n2mQHwPkWVdx'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:02.065663", "end": "2020-10-05 11:51:37.886674", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4B8YiTLcEP8tr6fsum1k8n2mQHwPkWVdx"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:35.821011", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-05T11:51:38.185 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:38.197 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:39.192 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenfBYCtJU64aMTLUviwqATtMUQYRxSqLoO'], 'uuids': ['dd2ba331-db8b-4fee-b0ef-3e218e814cc7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.121483", "end": "2020-10-05 11:51:39.069727", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenfBYCtJU64aMTLUviwqATtMUQYRxSqLoO"], "labels": [], "masters": [], "uuids": ["dd2ba331-db8b-4fee-b0ef-3e218e814cc7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:37.948244", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-05T11:51:39.204 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L4BN', 'wwn-0x5000c500918e822f'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '2b04c511-aa55-4d14-99bd-e89e73e1b5bb', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L4BN-part1', 'wwn-0x5000c500918e822f-part1'], 'uuids': ['2b04c511-aa55-4d14-99bd-e89e73e1b5bb']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918e822f', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5L4BN', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L4BN", "wwn-0x5000c500918e822f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L4BN-part1", "wwn-0x5000c500918e822f-part1"], "labels": [], "masters": [], "uuids": ["2b04c511-aa55-4d14-99bd-e89e73e1b5bb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "2b04c511-aa55-4d14-99bd-e89e73e1b5bb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5L4BN", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918e822f"}}, "skip_reason": 2020-10-05T11:51:39.205 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-10-05T11:51:39.435 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4lMuZDiTJ0ZH22FXhJhhh7iNugHwL1n9A'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.124662", "end": "2020-10-05 11:51:39.153405", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4lMuZDiTJ0ZH22FXhJhhh7iNugHwL1n9A"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:38.028743", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-05T11:51:39.446 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLCL', 'wwn-0x5000c50092940704'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '2b04c511-aa55-4d14-99bd-e89e73e1b5bb', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLCL-part1', 'wwn-0x5000c50092940704-part1'], 'uuids': ['2b04c511-aa55-4d14-99bd-e89e73e1b5bb']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092940704', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XLCL', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLCL", "wwn-0x5000c50092940704"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLCL-part1", "wwn-0x5000c50092940704-part1"], "labels": [], "masters": [], "uuids": ["2b04c511-aa55-4d14-99bd-e89e73e1b5bb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "2b04c511-aa55-4d14-99bd-e89e73e1b5bb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLCL", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092940704"}}, "skip_reason": 2020-10-05T11:51:39.448 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-10-05T11:51:40.503 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-LPVlAx-5XjH-PHe9-tdKz-pXc1-b1Fo-U6EpsM', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400N7400BGN', 'nvme-nvme.8086-504846543632303430304e3734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.187273", "end": "2020-10-05 11:51:40.384366", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-LPVlAx-5XjH-PHe9-tdKz-pXc1-b1Fo-U6EpsM", "nvme-INTEL_SSDPEDMD400G4_PHFT620400N7400BGN", "nvme-nvme.8086-504846543632303430304e3734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:39.197093", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-10-05T11:51:40.505 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-05T11:51:40.516 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:40.516 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:40.768 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-pbJAt0-DB1u-j0qr-Kcln-Gh1x-KKIW-aMndW4', 'nvme-INTEL_SSDPEDMD400G4_CVFT6233005J400BGN', 'nvme-nvme.8086-43564654363233333030354a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.193949", "end": "2020-10-05 11:51:40.476615", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-pbJAt0-DB1u-j0qr-Kcln-Gh1x-KKIW-aMndW4", "nvme-INTEL_SSDPEDMD400G4_CVFT6233005J400BGN", "nvme-nvme.8086-43564654363233333030354a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:39.282666", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-10-05T11:51:40.770 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:40.781 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:41.781 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenWD4orANdOD2dy4n8wtrxpIQHL1vI6Xqe'], 'uuids': ['13cf313a-34b9-4a84-b333-3f83c9be26d3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.145311", "end": "2020-10-05 11:51:41.662276", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenWD4orANdOD2dy4n8wtrxpIQHL1vI6Xqe"], "labels": [], "masters": [], "uuids": ["13cf313a-34b9-4a84-b333-3f83c9be26d3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:40.516965", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-05T11:51:41.792 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:41.803 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:42.046 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4RSZhjnOq08BH6uBDVsOdikG3mzXeMfhQ'], 'uuids': ['922787cc-4384-41ec-88da-01e317dd54df']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.146177", "end": "2020-10-05 11:51:41.762186", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4RSZhjnOq08BH6uBDVsOdikG3mzXeMfhQ"], "labels": [], "masters": [], "uuids": ["922787cc-4384-41ec-88da-01e317dd54df"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:40.616009", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-05T11:51:42.058 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:42.069 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:43.255 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenzwUVjb9a5xm5LEwUHGoS6DuQ1G0gC1Rf'], 'uuids': ['540b163d-f017-4d3b-badc-a065f1a78be9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.333074", "end": "2020-10-05 11:51:43.136469", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenzwUVjb9a5xm5LEwUHGoS6DuQ1G0gC1Rf"], "labels": [], "masters": [], "uuids": ["540b163d-f017-4d3b-badc-a065f1a78be9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:41.803395", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-05T11:51:43.266 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:43.319 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4MffqNXeiOttppbY9P67Sij8ZhKL5jAD8'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.126670", "end": "2020-10-05 11:51:43.028705", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4MffqNXeiOttppbY9P67Sij8ZhKL5jAD8"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:41.902035", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-05T11:51:43.331 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:44.578 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND44ozFi80afiOuhL37uFfRkia8DRQJadQH'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.130869", "end": "2020-10-05 11:51:44.289365", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND44ozFi80afiOuhL37uFfRkia8DRQJadQH"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:43.158496", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-05T11:51:44.623 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:44 +0000 (0:00:08.701) 0:01:15.354 ******** 2020-10-05T11:51:44.671 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-10-05T11:51:44.673 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** 2020-10-05T11:51:44.673 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0Fen00UXjUd1gB23hrj42CrrFA0DTfEpbK28'], 'uuids': ['a778db82-e146-4312-8bda-d429872ee367']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.291593", "end": "2020-10-05 11:51:44.553744", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0Fen00UXjUd1gB23hrj42CrrFA0DTfEpbK28"], "labels": [], "masters": [], "uuids": ["a778db82-e146-4312-8bda-d429 2020-10-05T11:51:44.675 INFO:teuthology.task.ansible.out:872ee367"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:43.262151", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-05T11:51:44.729 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:44 +0000 (0:00:00.105) 0:01:15.459 ******** 2020-10-05T11:51:44.788 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-10-05T11:51:44.789 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:44.945 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4B8YiTLcEP8tr6fsum1k8n2mQHwPkWVdx'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.155379", "end": "2020-10-05 11:51:44.659451", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4B8YiTLcEP8tr6fsum1k8n2mQHwPkWVdx"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:44.504072", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15063 s, 766 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15063 s, 766 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:44.946 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:44.958 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:45.085 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenWchSPd80EWrXjJmViOVu0ypVT7WxGdcS'], 'uuids': ['78c4d1b1-6414-4f96-a5fb-33caa234c757']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.158335", "end": "2020-10-05 11:51:44.956903", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenWchSPd80EWrXjJmViOVu0ypVT7WxGdcS"], "labels": [], "masters": [], "uuids": ["78c4d1b1-6414-4f96-a5fb-33caa234c757"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:44.798568", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153639 s, 751 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153639 s, 751 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:45.087 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:45.098 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:45.244 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4lMuZDiTJ0ZH22FXhJhhh7iNugHwL1n9A'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.167570", "end": "2020-10-05 11:51:44.959454", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4lMuZDiTJ0ZH22FXhJhhh7iNugHwL1n9A"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:44.791884", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.16276 s, 709 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.16276 s, 709 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:45.257 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLCL', 'wwn-0x5000c50092940704'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '2b04c511-aa55-4d14-99bd-e89e73e1b5bb', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLCL-part1', 'wwn-0x5000c50092940704-part1'], 'uuids': ['2b04c511-aa55-4d14-99bd-e89e73e1b5bb']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092940704', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XLCL', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLCL", "wwn-0x5000c50092940704"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLCL-part1", "wwn-0x5000c50092940704-part1"], "labels": [], "masters": [], "uuids": ["2b04c511-aa55-4d14-99bd-e89e73e1b5bb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "2b04c511-aa55-4d14-99bd-e89e73e1b5bb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLCL", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092940704"}}, "skip_reason": 2020-10-05T11:51:45.258 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-10-05T11:51:45.375 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenfBYCtJU64aMTLUviwqATtMUQYRxSqLoO'], 'uuids': ['dd2ba331-db8b-4fee-b0ef-3e218e814cc7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.160224", "end": "2020-10-05 11:51:45.253604", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenfBYCtJU64aMTLUviwqATtMUQYRxSqLoO"], "labels": [], "masters": [], "uuids": ["dd2ba331-db8b-4fee-b0ef-3e218e814cc7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:45.093380", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155615 s, 741 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155615 s, 741 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:45.376 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L4BN', 'wwn-0x5000c500918e822f'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '2b04c511-aa55-4d14-99bd-e89e73e1b5bb', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L4BN-part1', 'wwn-0x5000c500918e822f-part1'], 'uuids': ['2b04c511-aa55-4d14-99bd-e89e73e1b5bb']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918e822f', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5L4BN', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L4BN", "wwn-0x5000c500918e822f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L4BN-part1", "wwn-0x5000c500918e822f-part1"], "labels": [], "masters": [], "uuids": ["2b04c511-aa55-4d14-99bd-e89e73e1b5bb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "2b04c511-aa55-4d14-99bd-e89e73e1b5bb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5L4BN", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918e822f"}}, "skip_reason": 2020-10-05T11:51:45.378 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-10-05T11:51:45.430 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-pbJAt0-DB1u-j0qr-Kcln-Gh1x-KKIW-aMndW4', 'nvme-INTEL_SSDPEDMD400G4_CVFT6233005J400BGN', 'nvme-nvme.8086-43564654363233333030354a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.053366", "end": "2020-10-05 11:51:45.140046", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-pbJAt0-DB1u-j0qr-Kcln-Gh1x-KKIW-aMndW4", "nvme-INTEL_SSDPEDMD400G4_CVFT6233005J400BGN", "nvme-nvme.8086-43564654363233333030354a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:45.086680", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0486951 s, 2.4 GB/s", "std 2020-10-05T11:51:45.432 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0486951 s, 2.4 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:45.444 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:45.550 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-LPVlAx-5XjH-PHe9-tdKz-pXc1-b1Fo-U6EpsM', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400N7400BGN', 'nvme-nvme.8086-504846543632303430304e3734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.051981", "end": "2020-10-05 11:51:45.430975", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-LPVlAx-5XjH-PHe9-tdKz-pXc1-b1Fo-U6EpsM", "nvme-INTEL_SSDPEDMD400G4_PHFT620400N7400BGN", "nvme-nvme.8086-504846543632303430304e3734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:45.378994", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0473658 s, 2.4 GB/s", "std 2020-10-05T11:51:45.551 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0473658 s, 2.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:45.561 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:45.573 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:45.710 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4RSZhjnOq08BH6uBDVsOdikG3mzXeMfhQ'], 'uuids': ['922787cc-4384-41ec-88da-01e317dd54df']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.144165", "end": "2020-10-05 11:51:45.425001", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4RSZhjnOq08BH6uBDVsOdikG3mzXeMfhQ"], "labels": [], "masters": [], "uuids": ["922787cc-4384-41ec-88da-01e317dd54df"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:45.280836", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141488 s, 815 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141488 s, 815 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:45.722 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:45.723 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:45.840 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenWD4orANdOD2dy4n8wtrxpIQHL1vI6Xqe'], 'uuids': ['13cf313a-34b9-4a84-b333-3f83c9be26d3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.146860", "end": "2020-10-05 11:51:45.718936", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenWD4orANdOD2dy4n8wtrxpIQHL1vI6Xqe"], "labels": [], "masters": [], "uuids": ["13cf313a-34b9-4a84-b333-3f83c9be26d3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:45.572076", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.143255 s, 805 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.143255 s, 805 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:45.851 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:45.862 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:46.009 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4MffqNXeiOttppbY9P67Sij8ZhKL5jAD8'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.157782", "end": "2020-10-05 11:51:45.717810", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND4MffqNXeiOttppbY9P67Sij8ZhKL5jAD8"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:45.560028", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153125 s, 753 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153125 s, 753 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:46.010 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:46.137 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenzwUVjb9a5xm5LEwUHGoS6DuQ1G0gC1Rf'], 'uuids': ['540b163d-f017-4d3b-badc-a065f1a78be9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.160958", "end": "2020-10-05 11:51:46.015700", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0FenzwUVjb9a5xm5LEwUHGoS6DuQ1G0gC1Rf"], "labels": [], "masters": [], "uuids": ["540b163d-f017-4d3b-badc-a065f1a78be9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:45.854742", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156217 s, 738 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156217 s, 738 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:46.148 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:46.295 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND44ozFi80afiOuhL37uFfRkia8DRQJadQH'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.158794", "end": "2020-10-05 11:51:46.011245", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-milx3REl8GBdTkth6xH6g9zl90YBFND44ozFi80afiOuhL37uFfRkia8DRQJadQH"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:45.852451", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154189 s, 748 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154189 s, 748 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:46.339 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:46 +0000 (0:00:01.610) 0:01:17.070 ******** 2020-10-05T11:51:46.432 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0Fen00UXjUd1gB23hrj42CrrFA0DTfEpbK28'], 'uuids': ['a778db82-e146-4312-8bda-d429872ee367']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.158677", "end": "2020-10-05 11:51:46.304257", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-2Hcss0ENeIhfUGcKTnqRLlE3rWPf0Fen00UXjUd1gB23hrj42CrrFA0DTfEpbK28"], "labels": [], "masters": [], "uuids": ["a778db82-e146-4312-8bda-d429872ee367"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-05 11:51:46.145580", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153888 s, 750 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153888 s, 750 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:46.477 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:46 +0000 (0:00:00.137) 0:01:17.208 ******** 2020-10-05T11:51:46.631 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-10-05T11:51:46.633 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.150172", "end": "2020-10-05 11:51:46.340639", "rc": 0, "start": "2020-10-05 11:51:46.190467", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:46.666 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:46 +0000 (0:00:00.188) 0:01:17.397 ******** 2020-10-05T11:51:46.778 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.159231", "end": "2020-10-05 11:51:46.652416", "rc": 0, "start": "2020-10-05 11:51:46.493185", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:46.814 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:46 +0000 (0:00:00.148) 0:01:17.545 ******** 2020-10-05T11:51:46.843 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-10-05T11:51:46.844 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.049276", "end": "2020-10-05 11:51:46.563172", "rc": 0, "start": "2020-10-05 11:51:46.513896", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:46.878 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:46 +0000 (0:00:00.063) 0:01:17.609 ******** 2020-10-05T11:51:46.905 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-10-05T11:51:46.941 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:46 +0000 (0:00:00.063) 0:01:17.672 ******** 2020-10-05T11:51:46.968 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-10-05T11:51:46.970 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.005 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.063) 0:01:17.736 ******** 2020-10-05T11:51:47.031 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-10-05T11:51:47.033 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.066 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.061) 0:01:17.797 ******** 2020-10-05T11:51:47.073 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-10-05T11:51:47.075 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.108038", "end": "2020-10-05 11:51:46.937958", "rc": 0, "start": "2020-10-05 11:51:46.829920", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:51:47.109 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.043) 0:01:17.840 ******** 2020-10-05T11:51:47.116 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-10-05T11:51:47.118 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.153 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.043) 0:01:17.884 ******** 2020-10-05T11:51:47.160 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-10-05T11:51:47.198 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.044) 0:01:17.928 ******** 2020-10-05T11:51:47.204 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-10-05T11:51:47.206 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.242 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.044) 0:01:17.973 ******** 2020-10-05T11:51:47.248 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-10-05T11:51:47.250 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.288 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.045) 0:01:18.019 ******** 2020-10-05T11:51:47.315 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-10-05T11:51:47.317 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.350 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.061) 0:01:18.081 ******** 2020-10-05T11:51:47.367 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-10-05T11:51:47.369 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-05T11:51:47.402 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.052) 0:01:18.133 ******** 2020-10-05T11:51:47.409 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-10-05T11:51:47.411 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.448 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.045) 0:01:18.179 ******** 2020-10-05T11:51:47.456 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-10-05T11:51:47.457 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'block_used': 13639631, 'uuid': '2b04c511-aa55-4d14-99bd-e89e73e1b5bb', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226455477, 'size_available': 927561633792, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113890, 'block_size': 4096, 'inode_available': 60941086}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226455477, "block_size": 4096, "block_total": 240095108, "block_used": 13639631, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941086, "inode_total": 61054976, "inode_used": 113890, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927561633792, "size_total": 983429562368, "uuid": "2b04c511-aa55-4d14-99bd-e89e73e1b5bb"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.491 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.043) 0:01:18.222 ******** 2020-10-05T11:51:47.498 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-10-05T11:51:47.500 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.534 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.042) 0:01:18.265 ******** 2020-10-05T11:51:47.542 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-10-05T11:51:47.544 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.577 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.043) 0:01:18.308 ******** 2020-10-05T11:51:47.604 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-05T11:51:47.606 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.640 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.062) 0:01:18.370 ******** 2020-10-05T11:51:47.657 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-10-05T11:51:47.658 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-05T11:51:47.692 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.052) 0:01:18.423 ******** 2020-10-05T11:51:47.702 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-05T11:51:47.704 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.744 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.051) 0:01:18.475 ******** 2020-10-05T11:51:47.750 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-10-05T11:51:47.751 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'block_used': 13639640, 'uuid': '2b04c511-aa55-4d14-99bd-e89e73e1b5bb', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226455468, 'size_available': 927561596928, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113890, 'block_size': 4096, 'inode_available': 60941086}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226455468, "block_size": 4096, "block_total": 240095108, "block_used": 13639640, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941086, "inode_total": 61054976, "inode_used": 113890, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927561596928, "size_total": 983429562368, "uuid": "2b04c511-aa55-4d14-99bd-e89e73e1b5bb"}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.787 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.043) 0:01:18.518 ******** 2020-10-05T11:51:47.794 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-10-05T11:51:47.796 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.833 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.045) 0:01:18.564 ******** 2020-10-05T11:51:47.840 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-10-05T11:51:47.842 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.889 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.055) 0:01:18.619 ******** 2020-10-05T11:51:47.898 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-10-05T11:51:47.900 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.937 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.047) 0:01:18.667 ******** 2020-10-05T11:51:47.943 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-05T11:51:47.944 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:47.982 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:47 +0000 (0:00:00.045) 0:01:18.713 ******** 2020-10-05T11:51:47.989 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-10-05T11:51:47.991 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:48.025 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:48 +0000 (0:00:00.042) 0:01:18.756 ******** 2020-10-05T11:51:48.039 INFO:teuthology.task.ansible.out: 2020-10-05T11:51:48.041 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:48.094 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:48 +0000 (0:00:00.068) 0:01:18.825 ******** 2020-10-05T11:51:48.124 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-10-05T11:51:48.125 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:48.158 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:48 +0000 (0:00:00.063) 0:01:18.889 ******** 2020-10-05T11:51:48.185 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-10-05T11:51:48.186 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:48.219 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:48 +0000 (0:00:00.061) 0:01:18.950 ******** 2020-10-05T11:51:48.246 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-10-05T11:51:48.247 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:48.280 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:48 +0000 (0:00:00.060) 0:01:19.011 ******** 2020-10-05T11:51:48.598 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-10-05T11:51:48.600 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-10-05T11:51:48.635 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:48 +0000 (0:00:00.355) 0:01:19.366 ******** 2020-10-05T11:51:48.643 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-10-05T11:51:48.679 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:48 +0000 (0:00:00.043) 0:01:19.410 ******** 2020-10-05T11:51:49.177 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-10-05T11:51:49.179 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-05T11:51:49.188 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-05T11:51:49.407 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-05T11:51:49.440 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-05T11:51:49.649 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-05T11:51:49.681 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-05T11:51:49.893 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-05T11:51:49.915 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-05T11:51:50.140 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-05T11:51:50.177 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:50 +0000 (0:00:01.497) 0:01:20.908 ******** 2020-10-05T11:51:50.184 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-05T11:51:50.222 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:50 +0000 (0:00:00.044) 0:01:20.953 ******** 2020-10-05T11:51:50.304 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-10-05T11:51:50.306 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-10-05T11:51:50.340 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:50 +0000 (0:00:00.118) 0:01:21.071 ******** 2020-10-05T11:51:50.359 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-10-05T11:51:50.400 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:50 +0000 (0:00:00.059) 0:01:21.131 ******** 2020-10-05T11:51:50.494 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-10-05T11:51:50.496 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-05T11:51:50.549 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-05T11:51:50.614 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-05T11:51:50.668 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-05T11:51:50.732 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-05T11:51:50.785 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-05T11:51:50.838 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-05T11:51:50.850 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:50.888 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:50 +0000 (0:00:00.487) 0:01:21.618 ******** 2020-10-05T11:51:50.905 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-05T11:51:50.917 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:50.954 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:50 +0000 (0:00:00.066) 0:01:21.685 ******** 2020-10-05T11:51:51.023 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-10-05T11:51:51.025 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-10-05T11:51:51.059 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:51 +0000 (0:00:00.105) 0:01:21.790 ******** 2020-10-05T11:51:51.087 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-10-05T11:51:51.088 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-10-05T11:51:51.089 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-10-05T11:51:51.126 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:51 +0000 (0:00:00.066) 0:01:21.857 ******** 2020-10-05T11:51:51.163 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:51 +0000 (0:00:00.037) 0:01:21.894 ******** 2020-10-05T11:51:51.204 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-10-05T11:51:51.252 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:51 +0000 (0:00:00.088) 0:01:21.983 ******** 2020-10-05T11:51:51.602 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-10-05T11:51:51.604 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true} changed: [smithi081.front.sepia.ceph.com] => {"changed": true} 2020-10-05T11:51:51.639 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:51 +0000 (0:00:00.387) 0:01:22.370 ******** 2020-10-05T11:51:51.671 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:51 +0000 (0:00:00.031) 0:01:22.402 ******** 2020-10-05T11:51:52.072 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi081.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-10-05T11:51:52.107 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:52 +0000 (0:00:00.436) 0:01:22.838 ******** 2020-10-05T11:51:52.116 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-10-05T11:51:52.179 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:52 +0000 (0:00:00.071) 0:01:22.909 ******** 2020-10-05T11:51:52.261 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-10-05T11:51:52.263 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "gid": 1230, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-10-05T11:51:52.297 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:52 +0000 (0:00:00.118) 0:01:23.028 ******** 2020-10-05T11:51:52.315 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 1230, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-10-05T11:51:52.352 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:52 +0000 (0:00:00.054) 0:01:23.083 ******** 2020-10-05T11:51:52.433 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-10-05T11:51:52.470 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:52 +0000 (0:00:00.117) 0:01:23.200 ******** 2020-10-05T11:51:52.498 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-10-05T11:51:52.533 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:52 +0000 (0:00:00.063) 0:01:23.264 ******** 2020-10-05T11:51:52.791 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1230, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-10-05T11:51:52.827 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:52 +0000 (0:00:00.293) 0:01:23.557 ******** 2020-10-05T11:51:52.855 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1230, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-10-05T11:51:52.891 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:52 +0000 (0:00:00.064) 0:01:23.622 ******** 2020-10-05T11:51:53.158 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-10-05T11:51:53.160 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-10-05T11:51:53.194 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:53 +0000 (0:00:00.302) 0:01:23.925 ******** 2020-10-05T11:51:53.212 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-10-05T11:51:53.255 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:53 +0000 (0:00:00.060) 0:01:23.986 ******** 2020-10-05T11:51:54.085 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-10-05T11:51:54.087 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"cache_update_time": 1601898622, "cache_updated": false, "changed": false} 2020-10-05T11:51:54.122 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:54 +0000 (0:00:00.866) 0:01:24.852 ******** 2020-10-05T11:51:54.149 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1601898617, "cache_updated": false, "changed": false} 2020-10-05T11:51:54.184 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:54 +0000 (0:00:00.062) 0:01:24.915 ******** 2020-10-05T11:51:54.308 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-10-05T11:51:54.310 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.048052", "end": "2020-10-05 11:51:54.188384", "rc": 0, "start": "2020-10-05 11:51:54.140332", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-10-05T11:51:54.344 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:54 +0000 (0:00:00.160) 0:01:25.075 ******** 2020-10-05T11:51:54.361 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.047375", "end": "2020-10-05 11:51:54.075778", "rc": 0, "start": "2020-10-05 11:51:54.028403", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-10-05T11:51:54.396 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:54 +0000 (0:00:00.051) 0:01:25.127 ******** 2020-10-05T11:51:54.402 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-10-05T11:51:54.404 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:54.438 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:54 +0000 (0:00:00.042) 0:01:25.169 ******** 2020-10-05T11:51:54.445 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:54.480 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:54 +0000 (0:00:00.041) 0:01:25.210 ******** 2020-10-05T11:51:54.486 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-10-05T11:51:54.488 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:54.525 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:54 +0000 (0:00:00.045) 0:01:25.255 ******** 2020-10-05T11:51:54.531 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:54.566 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:54 +0000 (0:00:00.041) 0:01:25.297 ******** 2020-10-05T11:51:55.422 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-10-05T11:51:55.424 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1601898617, "cache_updated": false, "changed": false} 2020-10-05T11:51:55.468 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:55 +0000 (0:00:00.901) 0:01:26.199 ******** 2020-10-05T11:51:55.476 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"cache_update_time": 1601898622, "cache_updated": false, "changed": false} 2020-10-05T11:51:55.516 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:55 +0000 (0:00:00.048) 0:01:26.247 ******** 2020-10-05T11:51:55.525 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-10-05T11:51:55.526 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:55.562 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:55 +0000 (0:00:00.046) 0:01:26.293 ******** 2020-10-05T11:51:55.570 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:55.609 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:55 +0000 (0:00:00.046) 0:01:26.340 ******** 2020-10-05T11:51:55.868 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-10-05T11:51:55.869 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-10-05T11:51:55.903 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:55 +0000 (0:00:00.293) 0:01:26.633 ******** 2020-10-05T11:51:55.920 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-10-05T11:51:55.955 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:55 +0000 (0:00:00.052) 0:01:26.686 ******** 2020-10-05T11:51:55.961 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-10-05T11:51:55.963 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:55.998 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:55 +0000 (0:00:00.043) 0:01:26.729 ******** 2020-10-05T11:51:56.006 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:56.042 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:56 +0000 (0:00:00.044) 0:01:26.773 ******** 2020-10-05T11:51:56.207 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-10-05T11:51:56.208 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-10-05 11:49:37 UTC", "ActiveEnterTimestampMonotonic": "17989027", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service systemd-journald.socket system.slice basic.target network.target sysinit.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-10-05 11:49:37 UTC", "AssertTimestampMonotonic": "17836125", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-10-05 11:49:37 UTC", "ConditionTimestampMonotonic": "17836124", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-10-05T11:51:56.210 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1009", "ExecMainStartTimestamp": "Mon 2020-10-05 11:49:37 UTC", "ExecMainStartTimestampMonotonic": "17989012", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-10-05 11:49:37 UTC", "InactiveExitTimestampMonotonic": "17837038", "InvocationID": "c36a42d128324eaa8b029499fb2eadee", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-10-05T11:51:56.211 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1009", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-10-05 11:49:37 UTC", "S 2020-10-05T11:51:56.213 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "17989027", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-10-05 11:49:37 UTC", "WatchdogTimestampMonotonic": "17989026", "WatchdogUSec": "0"}} 2020-10-05T11:51:56.244 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:56 +0000 (0:00:00.201) 0:01:26.975 ******** 2020-10-05T11:51:56.263 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-10-05 11:49:16 UTC", "ActiveEnterTimestampMonotonic": "17621850", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target network.target systemd-journald.socket systemd-tmpfiles-setup.service system.slice -.mount basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-10-05 11:49:16 UTC", "AssertTimestampMonotonic": "17476060", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-10-05 11:49:16 UTC", "ConditionTimestampMonotonic": "17476060", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-10-05T11:51:56.265 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1177", "ExecMainStartTimestamp": "Mon 2020-10-05 11:49:16 UTC", "ExecMainStartTimestampMonotonic": "17621835", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-10-05 11:49:16 UTC", "InactiveExitTimestampMonotonic": "17476729", "InvocationID": "3fc86e962ecf43298829f0f3fb4874c0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-10-05T11:51:56.266 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1177", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-10-05 11:49:16 UTC", "S 2020-10-05T11:51:56.268 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "17621850", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-10-05 11:49:16 UTC", "WatchdogTimestampMonotonic": "17621849", "WatchdogUSec": "0"}} 2020-10-05T11:51:56.298 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:56 +0000 (0:00:00.053) 0:01:27.029 ******** 2020-10-05T11:51:56.305 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-05T11:51:56.306 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-10-05T11:51:56.340 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:56 +0000 (0:00:00.041) 0:01:27.071 ******** 2020-10-05T11:51:56.347 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-10-05T11:51:56.382 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:56 +0000 (0:00:00.041) 0:01:27.113 ******** 2020-10-05T11:51:56.389 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-05T11:51:56.390 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:56.424 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:56 +0000 (0:00:00.041) 0:01:27.155 ******** 2020-10-05T11:51:56.432 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:56.467 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:56 +0000 (0:00:00.042) 0:01:27.198 ******** 2020-10-05T11:51:56.474 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-10-05T11:51:56.475 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:56.524 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:56 +0000 (0:00:00.057) 0:01:27.255 ******** 2020-10-05T11:51:56.532 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:56.571 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:56 +0000 (0:00:00.046) 0:01:27.302 ******** 2020-10-05T11:51:57.375 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1601898617, "cache_updated": false, "changed": false} 2020-10-05T11:51:57.411 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:57 +0000 (0:00:00.839) 0:01:28.142 ******** 2020-10-05T11:51:57.439 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-10-05T11:51:57.440 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:57.474 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:57 +0000 (0:00:00.062) 0:01:28.205 ******** 2020-10-05T11:51:57.481 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-10-05T11:51:57.483 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"cache_update_time": 1601898622, "cache_updated": false, "changed": false} 2020-10-05T11:51:57.521 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:57 +0000 (0:00:00.047) 0:01:28.252 ******** 2020-10-05T11:51:57.549 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-10-05T11:51:57.551 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:51:57.584 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:57 +0000 (0:00:00.063) 0:01:28.315 ******** 2020-10-05T11:51:57.601 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-10-05T11:51:57.603 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 1230, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-10-05T11:51:57.641 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:57 +0000 (0:00:00.056) 0:01:28.372 ******** 2020-10-05T11:51:57.711 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "gid": 1230, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-10-05T11:51:57.747 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:57 +0000 (0:00:00.105) 0:01:28.478 ******** 2020-10-05T11:51:57.940 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-10-05T11:51:57.942 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1230, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-10-05T11:51:57.976 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:57 +0000 (0:00:00.228) 0:01:28.707 ******** 2020-10-05T11:51:58.132 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1230, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-10-05T11:51:58.175 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:58 +0000 (0:00:00.198) 0:01:28.905 ******** 2020-10-05T11:51:58.984 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-10-05T11:51:58.986 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-10-05T11:51:59.023 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:59 +0000 (0:00:00.848) 0:01:29.753 ******** 2020-10-05T11:51:59.029 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-10-05T11:51:59.066 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:59 +0000 (0:00:00.043) 0:01:29.797 ******** 2020-10-05T11:51:59.512 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-10-05T11:51:59.514 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false} 2020-10-05T11:51:59.548 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:59 +0000 (0:00:00.482) 0:01:30.279 ******** 2020-10-05T11:51:59.566 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false} 2020-10-05T11:51:59.602 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:59 +0000 (0:00:00.054) 0:01:30.333 ******** 2020-10-05T11:51:59.609 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-10-05T11:51:59.610 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-10-05T11:51:59.647 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:59 +0000 (0:00:00.045) 0:01:30.378 ******** 2020-10-05T11:51:59.655 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-10-05T11:51:59.692 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:59 +0000 (0:00:00.044) 0:01:30.423 ******** 2020-10-05T11:51:59.782 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-10-05T11:51:59.784 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1601898598.875816, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1601898598.8718162, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 10413, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1601898598.8718162, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3466829222", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-10-05T11:51:59.818 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:59 +0000 (0:00:00.125) 0:01:30.548 ******** 2020-10-05T11:51:59.836 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1601898577.3715725, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1601898577.3675725, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 10413, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1601898577.3675725, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3466829222", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-10-05T11:51:59.872 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:51:59 +0000 (0:00:00.054) 0:01:30.603 ******** 2020-10-05T11:52:00.186 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi081.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-10-05T11:52:00.188 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-10-05T11:52:00.236 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:00 +0000 (0:00:00.363) 0:01:30.967 ******** 2020-10-05T11:52:00.272 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:00 +0000 (0:00:00.036) 0:01:31.003 ******** 2020-10-05T11:52:00.280 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi081.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-10-05T11:52:00.316 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:00 +0000 (0:00:00.044) 0:01:31.047 ******** 2020-10-05T11:52:00.323 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-10-05T11:52:00.397 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:00 +0000 (0:00:00.041) 0:01:31.089 ******** TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:00.400 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:00 +0000 (0:00:00.041) 0:01:31.130 ******** 2020-10-05T11:52:00.406 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:00.443 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:00 +0000 (0:00:00.043) 0:01:31.174 ******** 2020-10-05T11:52:00.524 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-10-05T11:52:00.526 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-10-05T11:52:00.560 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:00 +0000 (0:00:00.116) 0:01:31.291 ******** 2020-10-05T11:52:00.579 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-10-05T11:52:00.614 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:00 +0000 (0:00:00.053) 0:01:31.345 ******** 2020-10-05T11:52:00.694 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-10-05T11:52:00.696 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-10-05T11:52:00.729 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:00 +0000 (0:00:00.115) 0:01:31.460 ******** 2020-10-05T11:52:00.756 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-10-05T11:52:00.758 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-10-05T11:52:00.793 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:00 +0000 (0:00:00.063) 0:01:31.523 ******** 2020-10-05T11:52:00.828 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:00 +0000 (0:00:00.035) 0:01:31.559 ******** 2020-10-05T11:52:00.837 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-10-05T11:52:00.838 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-10-05T11:52:00.839 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-10-05T11:52:00.850 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-10-05T11:52:00.851 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:00.888 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:00 +0000 (0:00:00.059) 0:01:31.619 ******** 2020-10-05T11:52:00.921 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:00 +0000 (0:00:00.033) 0:01:31.652 ******** 2020-10-05T11:52:00.933 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-10-05T11:52:00.935 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi081.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:00.947 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:00.947 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:00.987 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:00 +0000 (0:00:00.065) 0:01:31.718 ******** 2020-10-05T11:52:00.994 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-10-05T11:52:00.996 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-10-05T11:52:00.996 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.031 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.044) 0:01:31.762 ******** 2020-10-05T11:52:01.038 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-05T11:52:01.039 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.087 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.055) 0:01:31.817 ******** 2020-10-05T11:52:01.094 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-10-05T11:52:01.096 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.096 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.098 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.100 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.140 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.053) 0:01:31.871 ******** 2020-10-05T11:52:01.147 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-10-05T11:52:01.147 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.182 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.042) 0:01:31.913 ******** 2020-10-05T11:52:01.189 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-05T11:52:01.191 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.227 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.044) 0:01:31.958 ******** 2020-10-05T11:52:01.233 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-10-05T11:52:01.235 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.287 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.059) 0:01:32.017 ******** 2020-10-05T11:52:01.295 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-10-05T11:52:01.297 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.346 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.059) 0:01:32.077 ******** 2020-10-05T11:52:01.358 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-10-05T11:52:01.360 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.393 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.046) 0:01:32.124 ******** 2020-10-05T11:52:01.400 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-10-05T11:52:01.402 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.451 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.058) 0:01:32.182 ******** 2020-10-05T11:52:01.458 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-10-05T11:52:01.460 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.500 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.047) 0:01:32.230 ******** 2020-10-05T11:52:01.506 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-10-05T11:52:01.508 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.554 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.055) 0:01:32.285 ******** 2020-10-05T11:52:01.563 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-10-05T11:52:01.564 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.613 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.059) 0:01:32.344 ******** 2020-10-05T11:52:01.621 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-10-05T11:52:01.623 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.660 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.046) 0:01:32.391 ******** 2020-10-05T11:52:01.667 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-10-05T11:52:01.669 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.705 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.044) 0:01:32.435 ******** 2020-10-05T11:52:01.711 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-10-05T11:52:01.713 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.752 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.047) 0:01:32.483 ******** 2020-10-05T11:52:01.759 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-10-05T11:52:01.761 INFO:teuthology.task.ansible.out:skipping: [smithi081.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.796 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.044) 0:01:32.527 ******** 2020-10-05T11:52:01.805 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-10-05T11:52:01.806 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.851 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.053) 0:01:32.581 ******** 2020-10-05T11:52:01.879 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-10-05T11:52:01.881 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-05T11:52:01.916 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:01 +0000 (0:00:00.065) 0:01:32.647 ******** 2020-10-05T11:52:01.956 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-10-05T11:52:01.957 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.009639", "end": "2020-10-05 11:52:01.821851", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-10-05 11:52:01.812212", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:52:02.062 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005834", "end": "2020-10-05 11:52:01.945083", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-10-05 11:52:01.939249", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:52:02.074 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.009081", "end": "2020-10-05 11:52:01.779062", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-10-05 11:52:01.769981", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:52:02.183 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005400", "end": "2020-10-05 11:52:02.063152", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-10-05 11:52:02.057752", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-10-05T11:52:02.195 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005921", "end": "2020-10-05 11:52:01.899923", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-10-05 11:52:01.894002", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:52:02.312 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005425", "end": "2020-10-05 11:52:02.024591", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-10-05 11:52:02.019166", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-10-05T11:52:02.386 INFO:teuthology.task.ansible.out:ok: [smithi081.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.090124", "end": "2020-10-05 11:52:02.260440", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-10-05 11:52:02.170316", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:52:02.424 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:02 +0000 (0:00:00.507) 0:01:33.154 ******** 2020-10-05T11:52:02.452 INFO:teuthology.task.ansible.out: 2020-10-05T11:52:02.454 INFO:teuthology.task.ansible.out:TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi158.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.025152", "end": "2020-10-05 11:52:02.159439", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-10-05 11:52:02.134287", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-05T11:52:02.507 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:02 +0000 (0:00:00.083) 0:01:33.238 ******** 2020-10-05T11:52:02.549 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:02 +0000 (0:00:00.041) 0:01:33.280 ******** 2020-10-05T11:52:02.576 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-10-05T11:52:02.612 INFO:teuthology.task.ansible.out:Monday 05 October 2020 11:52:02 +0000 (0:00:00.063) 0:01:33.343 ******** 2020-10-05T11:52:02.640 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-10-05T11:52:02.641 INFO:teuthology.task.ansible.out:changed: [smithi081.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-10-05T11:52:02.732 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-10-05T11:52:02.827 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-10-05T11:52:02.831 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-10-05T11:52:02.837 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2020-10-05T11:52:02.838 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi081.front.sepia.ceph.com : ok=108 changed=26 unreachable=0 failed=0 skipped=181 rescued=0 ignored=0 smithi158.front.sepia.ceph.com : ok=108 changed=26 unreachable=0 failed=0 skipped=181 rescued=0 ignored=0 Monday 05 October 2020 11:52:02 +0000 (0:00:00.224) 0:01:33.568 ******** =============================================================================== testnode : Ensure packages are not present. ----------------------------- 8.98s testnode : Zap all non-root disks --------------------------------------- 8.70s testnode : Install packages --------------------------------------------- 8.47s testnode : Update apt cache. -------------------------------------------- 2.53s common : Update apt cache ----------------------------------------------- 1.99s testnode : Install apt keys --------------------------------------------- 1.72s Gathering Facts --------------------------------------------------------- 1.70s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.61s testnode : Create logical volume(s) ------------------------------------- 1.50s testnode : Install ntp package on apt based systems. -------------------- 0.90s testnode : Ensure perl-doc is installed on apt systems. ----------------- 0.87s testnode : Install packages via pip ------------------------------------- 0.85s testnode : Install python-pip on apt based systems. --------------------- 0.84s common : Make sure smartmontools is installed --------------------------- 0.83s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.80s Gathering Facts --------------------------------------------------------- 0.79s testnode : Install python-apt ------------------------------------------- 0.70s testnode : Install non aarch64 packages --------------------------------- 0.69s testnode : Upgrade 2020-10-05T11:52:02.840 INFO:teuthology.task.ansible.out: packages --------------------------------------------- 0.66s testnode : Make sure apt dependencies are installed --------------------- 0.60s 2020-10-05T11:52:03.210 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi158.front.sepia.ceph.com'), Remote(name='ubuntu@smithi081.front.sepia.ceph.com')] 2020-10-05T11:52:03.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-10-05T11:52:03.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:52:03.292 INFO:teuthology.orchestra.run.smithi158:> true 2020-10-05T11:52:03.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-10-05T11:52:03.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-05T11:52:03.571 INFO:teuthology.orchestra.run.smithi081:> true 2020-10-05T11:52:03.766 INFO:teuthology.run_tasks:Running task clock... 2020-10-05T11:52:03.777 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-10-05T11:52:03.778 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-10-05T11:52:03.778 INFO:teuthology.orchestra.run.smithi158:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-10-05T11:52:03.841 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Oct 11:52:03 ntpd[6531]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-10-05T11:52:03.841 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Oct 11:52:03 ntpd[6531]: Command line: ntpd -gq 2020-10-05T11:52:03.842 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Oct 11:52:03 ntpd[6531]: proto: precision = 0.124 usec (-23) 2020-10-05T11:52:03.843 INFO:teuthology.orchestra.run.smithi158.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-10-05T11:52:03.843 INFO:teuthology.orchestra.run.smithi158.stderr:restrict ::: KOD does nothing without LIMITED. 2020-10-05T11:52:03.843 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Oct 11:52:03 ntpd[6531]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-10-05T11:52:03.843 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Oct 11:52:03 ntpd[6531]: restrict ::: KOD does nothing without LIMITED. 2020-10-05T11:52:03.843 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Oct 11:52:03 ntpd[6531]: Listen and drop on 0 v6wildcard [::]:123 2020-10-05T11:52:03.844 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Oct 11:52:03 ntpd[6531]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-10-05T11:52:03.844 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Oct 11:52:03 ntpd[6531]: Listen normally on 2 lo 127.0.0.1:123 2020-10-05T11:52:03.844 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Oct 11:52:03 ntpd[6531]: Listen normally on 3 enp3s0f1 172.21.15.158:123 2020-10-05T11:52:03.845 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Oct 11:52:03 ntpd[6531]: Listen normally on 4 lo [::1]:123 2020-10-05T11:52:03.845 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Oct 11:52:03 ntpd[6531]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:726f%5]:123 2020-10-05T11:52:03.845 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Oct 11:52:03 ntpd[6531]: Listening on routing socket on fd #22 for interface updates 2020-10-05T11:52:04.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:04 ntpd[6531]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:04.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:04 ntpd[6531]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:04.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:04 ntpd[6531]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:04.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:04 ntpd[6531]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:05.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:05 ntpd[6531]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:05.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:05 ntpd[6531]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:05.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:05 ntpd[6531]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:05.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:05 ntpd[6531]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:05.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:05 ntpd[6531]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:05.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:05 ntpd[6531]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:05.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:05 ntpd[6531]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:05.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:05 ntpd[6531]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:06.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:06 ntpd[6531]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:06.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:06 ntpd[6531]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:06.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:06 ntpd[6531]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:06.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:06 ntpd[6531]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:07.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:07 ntpd[6531]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:07.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:07 ntpd[6531]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:07.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:07 ntpd[6531]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:07.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:07 ntpd[6531]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:07.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:07 ntpd[6531]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:07.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:07 ntpd[6531]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:07.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:07 ntpd[6531]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:07.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:07 ntpd[6531]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:07.844 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:07 ntpd[6531]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:07.844 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:07 ntpd[6531]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:07.844 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:07 ntpd[6531]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:07.844 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:07 ntpd[6531]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:08.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:08 ntpd[6531]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:08.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:08 ntpd[6531]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:08.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:08 ntpd[6531]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:08.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:08 ntpd[6531]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:09.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:09 ntpd[6531]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:09.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:09 ntpd[6531]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:09.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:09 ntpd[6531]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:09.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:09 ntpd[6531]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:09.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:09 ntpd[6531]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:09.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:09 ntpd[6531]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:09.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:09 ntpd[6531]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:09.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:09 ntpd[6531]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:09.844 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:09 ntpd[6531]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:09.844 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:09 ntpd[6531]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:09.844 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:09 ntpd[6531]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:09.844 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:09 ntpd[6531]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:10.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:10 ntpd[6531]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:10.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:10 ntpd[6531]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:10.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:10 ntpd[6531]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:10.842 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:10 ntpd[6531]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:10.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:10 ntpd[6531]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-10-05T11:52:10.843 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Oct 11:52:10 ntpd[6531]: can't open /var/log/ntpstats/loopstats.20201005: Permission denied 2020-10-05T11:52:10.843 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Oct 11:52:10 ntpd[6531]: ntpd: time set +0.257293 s 2020-10-05T11:52:10.843 INFO:teuthology.orchestra.run.smithi158.stdout:ntpd: time set +0.257293s 2020-10-05T11:52:10.887 INFO:teuthology.orchestra.run.smithi158.stdout: remote refid st t when poll reach delay offset jitter 2020-10-05T11:52:10.887 INFO:teuthology.orchestra.run.smithi158.stdout:============================================================================== 2020-10-05T11:52:10.887 INFO:teuthology.orchestra.run.smithi158.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-05T11:52:10.888 INFO:teuthology.orchestra.run.smithi158.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-05T11:52:10.888 INFO:teuthology.orchestra.run.smithi158.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-05T11:52:10.888 INFO:teuthology.orchestra.run.smithi158.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-05T11:52:10.889 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-10-05T11:52:10.890 INFO:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-10-05T11:52:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: 5 Oct 11:52:10 ntpd[6716]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-10-05T11:52:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: 5 Oct 11:52:10 ntpd[6716]: Command line: ntpd -gq 2020-10-05T11:52:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: 5 Oct 11:52:10 ntpd[6716]: proto: precision = 0.123 usec (-23) 2020-10-05T11:52:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-10-05T11:52:10.954 INFO:teuthology.orchestra.run.smithi081.stderr:restrict ::: KOD does nothing without LIMITED. 2020-10-05T11:52:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: 5 Oct 11:52:10 ntpd[6716]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-10-05T11:52:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: 5 Oct 11:52:10 ntpd[6716]: restrict ::: KOD does nothing without LIMITED. 2020-10-05T11:52:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: 5 Oct 11:52:10 ntpd[6716]: Listen and drop on 0 v6wildcard [::]:123 2020-10-05T11:52:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: 5 Oct 11:52:10 ntpd[6716]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-10-05T11:52:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: 5 Oct 11:52:10 ntpd[6716]: Listen normally on 2 lo 127.0.0.1:123 2020-10-05T11:52:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: 5 Oct 11:52:10 ntpd[6716]: Listen normally on 3 enp3s0f1 172.21.15.81:123 2020-10-05T11:52:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: 5 Oct 11:52:10 ntpd[6716]: Listen normally on 4 lo [::1]:123 2020-10-05T11:52:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: 5 Oct 11:52:10 ntpd[6716]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d753%5]:123 2020-10-05T11:52:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: 5 Oct 11:52:10 ntpd[6716]: Listening on routing socket on fd #22 for interface updates 2020-10-05T11:52:11.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:11 ntpd[6716]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:11.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:11 ntpd[6716]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:11.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:11 ntpd[6716]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:11.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:11 ntpd[6716]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:11.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:11 ntpd[6716]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:11.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:11 ntpd[6716]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:11.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:11 ntpd[6716]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:11.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:11 ntpd[6716]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:12.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:12 ntpd[6716]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:12.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:12 ntpd[6716]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:12.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:12 ntpd[6716]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:12.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:12 ntpd[6716]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:13.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:13 ntpd[6716]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:13.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:13 ntpd[6716]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:13.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:13 ntpd[6716]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:13.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:13 ntpd[6716]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:13.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:13 ntpd[6716]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:13.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:13 ntpd[6716]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:13.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:13 ntpd[6716]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:13.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:13 ntpd[6716]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:14.952 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:14 ntpd[6716]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:14.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:14 ntpd[6716]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:14.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:14 ntpd[6716]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:14.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:14 ntpd[6716]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:15.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:15 ntpd[6716]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:15.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:15 ntpd[6716]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:15.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:15 ntpd[6716]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:15.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:15 ntpd[6716]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:15.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:15 ntpd[6716]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:15.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:15 ntpd[6716]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:15.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:15 ntpd[6716]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:15.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:15 ntpd[6716]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:15.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:15 ntpd[6716]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:15.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:15 ntpd[6716]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:15.955 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:15 ntpd[6716]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:15.955 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:15 ntpd[6716]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:16.952 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:16 ntpd[6716]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:16.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:16 ntpd[6716]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:16.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:16 ntpd[6716]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:16.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:16 ntpd[6716]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:17.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:17 ntpd[6716]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-05T11:52:17.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:17 ntpd[6716]: can't open /var/log/ntpstats/rawstats.20201005: Permission denied 2020-10-05T11:52:17.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:17 ntpd[6716]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-05T11:52:17.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:17 ntpd[6716]: can't open /var/log/ntpstats/peerstats.20201005: Permission denied 2020-10-05T11:52:17.953 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:17 ntpd[6716]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-10-05T11:52:17.954 INFO:teuthology.orchestra.run.smithi081.stderr: 5 Oct 11:52:17 ntpd[6716]: can't open /var/log/ntpstats/loopstats.20201005: Permission denied 2020-10-05T11:52:17.954 INFO:teuthology.orchestra.run.smithi081.stdout: 5 Oct 11:52:17 ntpd[6716]: ntpd: time set +0.093169 s 2020-10-05T11:52:17.954 INFO:teuthology.orchestra.run.smithi081.stdout:ntpd: time set +0.093169s 2020-10-05T11:52:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2020-10-05T11:52:18.003 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2020-10-05T11:52:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-05T11:52:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-05T11:52:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-05T11:52:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-05T11:52:18.005 INFO:teuthology.run_tasks:Running task install... 2020-10-05T11:52:18.016 DEBUG:teuthology.task.install:project ceph 2020-10-05T11:52:18.017 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba'}} 2020-10-05T11:52:18.017 DEBUG:teuthology.task.install:config {'sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba'} 2020-10-05T11:52:18.017 INFO:teuthology.task.install:Using flavor: basic 2020-10-05T11:52:18.023 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-10-05T11:52:18.024 INFO:teuthology.task.install:extra packages: [] 2020-10-05T11:52:18.024 INFO:teuthology.orchestra.run.smithi158:> sudo lsb_release -is 2020-10-05T11:52:18.067 INFO:teuthology.orchestra.run.smithi158.stdout:Ubuntu 2020-10-05T11:52:18.072 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-05T11:52:18.073 INFO:teuthology.orchestra.run.smithi081:> sudo lsb_release -is 2020-10-05T11:52:18.074 INFO:teuthology.orchestra.run.smithi158:> sudo apt-key list | grep Ceph 2020-10-05T11:52:18.127 INFO:teuthology.orchestra.run.smithi081.stdout:Ubuntu 2020-10-05T11:52:18.133 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-05T11:52:18.133 INFO:teuthology.orchestra.run.smithi081:> sudo apt-key list | grep Ceph 2020-10-05T11:52:18.203 INFO:teuthology.orchestra.run.smithi158.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-10-05T11:52:18.225 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-10-05T11:52:18.262 INFO:teuthology.orchestra.run.smithi158.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-10-05T11:52:18.263 INFO:teuthology.orchestra.run.smithi158.stdout:uid [ unknown] Ceph.com (release key) 2020-10-05T11:52:18.264 INFO:teuthology.orchestra.run.smithi158:> sudo lsb_release -is 2020-10-05T11:52:18.282 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-10-05T11:52:18.282 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph.com (release key) 2020-10-05T11:52:18.283 INFO:teuthology.orchestra.run.smithi081:> sudo lsb_release -is 2020-10-05T11:52:18.311 INFO:teuthology.orchestra.run.smithi158.stdout:Ubuntu 2020-10-05T11:52:18.315 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-05T11:52:18.316 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2020-10-05T11:52:18.316 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=b726425d5bff271f4fe469ee94a9b80f7cad00ba 2020-10-05T11:52:18.332 INFO:teuthology.orchestra.run.smithi081.stdout:Ubuntu 2020-10-05T11:52:18.337 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-05T11:52:18.337 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2020-10-05T11:52:18.337 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=b726425d5bff271f4fe469ee94a9b80f7cad00ba 2020-10-05T11:52:18.485 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default/ 2020-10-05T11:52:18.485 INFO:teuthology.task.install.deb:Package version is 16.0.0-6145-gb726425d-1bionic 2020-10-05T11:52:18.495 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default/ 2020-10-05T11:52:18.495 INFO:teuthology.task.install.deb:Package version is 16.0.0-6145-gb726425d-1bionic 2020-10-05T11:52:18.776 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:52:18.776 INFO:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-10-05T11:52:18.779 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:52:18.779 INFO:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-10-05T11:52:18.783 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-10-05T11:52:18.784 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-10-05T11:52:18.791 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:52:18.791 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:52:18.791 INFO:teuthology.orchestra.run.smithi081.stderr:161 bytes copied, 7.1453e-05 s, 2.3 MB/s 2020-10-05T11:52:18.792 INFO:teuthology.orchestra.run.smithi081:> sudo apt-get update 2020-10-05T11:52:18.793 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:52:18.793 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:52:18.793 INFO:teuthology.orchestra.run.smithi158.stderr:161 bytes copied, 7.4793e-05 s, 2.2 MB/s 2020-10-05T11:52:18.794 INFO:teuthology.orchestra.run.smithi158:> sudo apt-get update 2020-10-05T11:52:18.983 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-10-05T11:52:19.094 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-10-05T11:52:19.094 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-10-05T11:52:19.096 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-10-05T11:52:19.161 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-10-05T11:52:19.175 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-10-05T11:52:19.229 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic InRelease 2020-10-05T11:52:19.240 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-10-05T11:52:19.244 INFO:teuthology.orchestra.run.smithi158.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic InRelease 2020-10-05T11:52:19.254 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-10-05T11:52:19.296 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2020-10-05T11:52:19.311 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2020-10-05T11:52:19.367 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic Release.gpg 2020-10-05T11:52:19.380 INFO:teuthology.orchestra.run.smithi158.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic Release.gpg 2020-10-05T11:52:19.434 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,951 B] 2020-10-05T11:52:19.448 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,951 B] 2020-10-05T11:52:19.513 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 Packages [16.1 kB] 2020-10-05T11:52:19.527 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 Packages [16.1 kB] 2020-10-05T11:52:19.610 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 26.8 kB in 1s (44.4 kB/s) 2020-10-05T11:52:19.705 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 26.8 kB in 1s (37.8 kB/s) 2020-10-05T11:52:20.832 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2020-10-05T11:52:20.876 INFO:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.0.0-6145-gb726425d-1bionic cephadm=16.0.0-6145-gb726425d-1bionic ceph-mds=16.0.0-6145-gb726425d-1bionic ceph-mgr=16.0.0-6145-gb726425d-1bionic ceph-common=16.0.0-6145-gb726425d-1bionic ceph-fuse=16.0.0-6145-gb726425d-1bionic ceph-test=16.0.0-6145-gb726425d-1bionic radosgw=16.0.0-6145-gb726425d-1bionic python3-rados=16.0.0-6145-gb726425d-1bionic python3-rgw=16.0.0-6145-gb726425d-1bionic python3-cephfs=16.0.0-6145-gb726425d-1bionic python3-rbd=16.0.0-6145-gb726425d-1bionic libcephfs2=16.0.0-6145-gb726425d-1bionic libcephfs-dev=16.0.0-6145-gb726425d-1bionic librados2=16.0.0-6145-gb726425d-1bionic librbd1=16.0.0-6145-gb726425d-1bionic rbd-fuse=16.0.0-6145-gb726425d-1bionic 2020-10-05T11:52:20.917 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2020-10-05T11:52:20.951 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2020-10-05T11:52:20.963 INFO:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.0.0-6145-gb726425d-1bionic cephadm=16.0.0-6145-gb726425d-1bionic ceph-mds=16.0.0-6145-gb726425d-1bionic ceph-mgr=16.0.0-6145-gb726425d-1bionic ceph-common=16.0.0-6145-gb726425d-1bionic ceph-fuse=16.0.0-6145-gb726425d-1bionic ceph-test=16.0.0-6145-gb726425d-1bionic radosgw=16.0.0-6145-gb726425d-1bionic python3-rados=16.0.0-6145-gb726425d-1bionic python3-rgw=16.0.0-6145-gb726425d-1bionic python3-cephfs=16.0.0-6145-gb726425d-1bionic python3-rbd=16.0.0-6145-gb726425d-1bionic libcephfs2=16.0.0-6145-gb726425d-1bionic libcephfs-dev=16.0.0-6145-gb726425d-1bionic librados2=16.0.0-6145-gb726425d-1bionic librbd1=16.0.0-6145-gb726425d-1bionic rbd-fuse=16.0.0-6145-gb726425d-1bionic 2020-10-05T11:52:21.042 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2020-10-05T11:52:21.178 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2020-10-05T11:52:21.179 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2020-10-05T11:52:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2020-10-05T11:52:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2020-10-05T11:52:21.338 INFO:teuthology.orchestra.run.smithi158.stdout:The following additional packages will be installed: 2020-10-05T11:52:21.339 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2020-10-05T11:52:21.340 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2020-10-05T11:52:21.340 INFO:teuthology.orchestra.run.smithi158.stdout: libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2020-10-05T11:52:21.340 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli 2020-10-05T11:52:21.340 INFO:teuthology.orchestra.run.smithi158.stdout: python-attr python-funcsigs python-pastedeploy-tpl python-pluggy python-py 2020-10-05T11:52:21.340 INFO:teuthology.orchestra.run.smithi158.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-10-05T11:52:21.340 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2020-10-05T11:52:21.341 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy3 python3-cryptography python3-cycler python3-dateutil 2020-10-05T11:52:21.341 INFO:teuthology.orchestra.run.smithi158.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2020-10-05T11:52:21.341 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-10-05T11:52:21.341 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-10-05T11:52:21.341 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-10-05T11:52:21.341 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-10-05T11:52:21.341 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-10-05T11:52:21.341 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-10-05T11:52:21.342 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2020-10-05T11:52:21.342 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-10-05T11:52:21.342 INFO:teuthology.orchestra.run.smithi158.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-10-05T11:52:21.342 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-10-05T11:52:21.342 INFO:teuthology.orchestra.run.smithi158.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-10-05T11:52:21.342 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-10-05T11:52:21.342 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-10-05T11:52:21.343 INFO:teuthology.orchestra.run.smithi158.stdout:Suggested packages: 2020-10-05T11:52:21.343 INFO:teuthology.orchestra.run.smithi158.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-10-05T11:52:21.343 INFO:teuthology.orchestra.run.smithi158.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-10-05T11:52:21.343 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2020-10-05T11:52:21.343 INFO:teuthology.orchestra.run.smithi158.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2020-10-05T11:52:21.344 INFO:teuthology.orchestra.run.smithi158.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2020-10-05T11:52:21.344 INFO:teuthology.orchestra.run.smithi158.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2020-10-05T11:52:21.344 INFO:teuthology.orchestra.run.smithi158.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2020-10-05T11:52:21.344 INFO:teuthology.orchestra.run.smithi158.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2020-10-05T11:52:21.344 INFO:teuthology.orchestra.run.smithi158.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2020-10-05T11:52:21.344 INFO:teuthology.orchestra.run.smithi158.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2020-10-05T11:52:21.344 INFO:teuthology.orchestra.run.smithi158.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2020-10-05T11:52:21.345 INFO:teuthology.orchestra.run.smithi158.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2020-10-05T11:52:21.345 INFO:teuthology.orchestra.run.smithi158.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2020-10-05T11:52:21.345 INFO:teuthology.orchestra.run.smithi158.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2020-10-05T11:52:21.345 INFO:teuthology.orchestra.run.smithi158.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2020-10-05T11:52:21.427 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2020-10-05T11:52:21.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2020-10-05T11:52:21.429 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2020-10-05T11:52:21.429 INFO:teuthology.orchestra.run.smithi081.stdout: libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2020-10-05T11:52:21.429 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli 2020-10-05T11:52:21.429 INFO:teuthology.orchestra.run.smithi081.stdout: python-attr python-funcsigs python-pastedeploy-tpl python-pluggy python-py 2020-10-05T11:52:21.429 INFO:teuthology.orchestra.run.smithi081.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-10-05T11:52:21.429 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2020-10-05T11:52:21.430 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy3 python3-cryptography python3-cycler python3-dateutil 2020-10-05T11:52:21.430 INFO:teuthology.orchestra.run.smithi081.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2020-10-05T11:52:21.430 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-10-05T11:52:21.430 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-10-05T11:52:21.430 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-10-05T11:52:21.430 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-10-05T11:52:21.430 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-10-05T11:52:21.431 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-10-05T11:52:21.431 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2020-10-05T11:52:21.431 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-10-05T11:52:21.431 INFO:teuthology.orchestra.run.smithi081.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-10-05T11:52:21.431 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-10-05T11:52:21.431 INFO:teuthology.orchestra.run.smithi081.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-10-05T11:52:21.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-10-05T11:52:21.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-10-05T11:52:21.433 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2020-10-05T11:52:21.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-10-05T11:52:21.433 INFO:teuthology.orchestra.run.smithi081.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-10-05T11:52:21.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2020-10-05T11:52:21.433 INFO:teuthology.orchestra.run.smithi081.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2020-10-05T11:52:21.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2020-10-05T11:52:21.434 INFO:teuthology.orchestra.run.smithi081.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2020-10-05T11:52:21.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2020-10-05T11:52:21.434 INFO:teuthology.orchestra.run.smithi081.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2020-10-05T11:52:21.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2020-10-05T11:52:21.435 INFO:teuthology.orchestra.run.smithi081.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2020-10-05T11:52:21.435 INFO:teuthology.orchestra.run.smithi081.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2020-10-05T11:52:21.435 INFO:teuthology.orchestra.run.smithi081.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2020-10-05T11:52:21.435 INFO:teuthology.orchestra.run.smithi081.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2020-10-05T11:52:21.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2020-10-05T11:52:21.435 INFO:teuthology.orchestra.run.smithi081.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2020-10-05T11:52:21.444 INFO:teuthology.orchestra.run.smithi158.stdout:The following NEW packages will be installed: 2020-10-05T11:52:21.444 INFO:teuthology.orchestra.run.smithi158.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-10-05T11:52:21.444 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2020-10-05T11:52:21.446 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq 2020-10-05T11:52:21.447 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2020-10-05T11:52:21.448 INFO:teuthology.orchestra.run.smithi158.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2020-10-05T11:52:21.448 INFO:teuthology.orchestra.run.smithi158.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2020-10-05T11:52:21.448 INFO:teuthology.orchestra.run.smithi158.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2020-10-05T11:52:21.449 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2020-10-05T11:52:21.449 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cryptography 2020-10-05T11:52:21.449 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2020-10-05T11:52:21.449 INFO:teuthology.orchestra.run.smithi158.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2020-10-05T11:52:21.450 INFO:teuthology.orchestra.run.smithi158.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2020-10-05T11:52:21.450 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-10-05T11:52:21.450 INFO:teuthology.orchestra.run.smithi158.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2020-10-05T11:52:21.451 INFO:teuthology.orchestra.run.smithi158.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2020-10-05T11:52:21.451 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2020-10-05T11:52:21.451 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2020-10-05T11:52:21.451 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyinotify python3-pyparsing python3-pytest python3-rados python3-rbd 2020-10-05T11:52:21.452 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze.lru python3-rgw python3-routes python3-rsa python3-scipy 2020-10-05T11:52:21.452 INFO:teuthology.orchestra.run.smithi158.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-10-05T11:52:21.452 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-10-05T11:52:21.452 INFO:teuthology.orchestra.run.smithi158.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-10-05T11:52:21.453 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-10-05T11:52:21.453 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2020-10-05T11:52:21.453 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages will be upgraded: 2020-10-05T11:52:21.454 INFO:teuthology.orchestra.run.smithi158.stdout: librados2 librbd1 2020-10-05T11:52:21.532 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2020-10-05T11:52:21.532 INFO:teuthology.orchestra.run.smithi081.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-10-05T11:52:21.532 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2020-10-05T11:52:21.533 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq 2020-10-05T11:52:21.533 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2020-10-05T11:52:21.534 INFO:teuthology.orchestra.run.smithi081.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2020-10-05T11:52:21.534 INFO:teuthology.orchestra.run.smithi081.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2020-10-05T11:52:21.534 INFO:teuthology.orchestra.run.smithi081.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2020-10-05T11:52:21.534 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2020-10-05T11:52:21.534 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cryptography 2020-10-05T11:52:21.534 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2020-10-05T11:52:21.535 INFO:teuthology.orchestra.run.smithi081.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2020-10-05T11:52:21.535 INFO:teuthology.orchestra.run.smithi081.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2020-10-05T11:52:21.535 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-10-05T11:52:21.535 INFO:teuthology.orchestra.run.smithi081.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2020-10-05T11:52:21.535 INFO:teuthology.orchestra.run.smithi081.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2020-10-05T11:52:21.535 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2020-10-05T11:52:21.535 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2020-10-05T11:52:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyinotify python3-pyparsing python3-pytest python3-rados python3-rbd 2020-10-05T11:52:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze.lru python3-rgw python3-routes python3-rsa python3-scipy 2020-10-05T11:52:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-10-05T11:52:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-10-05T11:52:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-10-05T11:52:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-10-05T11:52:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2020-10-05T11:52:21.537 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2020-10-05T11:52:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 librbd1 2020-10-05T11:52:21.609 INFO:teuthology.orchestra.run.smithi158.stdout:2 upgraded, 110 newly installed, 0 to remove and 0 not upgraded. 2020-10-05T11:52:21.609 INFO:teuthology.orchestra.run.smithi158.stdout:Need to get 167 MB of archives. 2020-10-05T11:52:21.610 INFO:teuthology.orchestra.run.smithi158.stdout:After this operation, 779 MB of additional disk space will be used. 2020-10-05T11:52:21.610 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 16.0.0-6145-gb726425d-1bionic [1,867 kB] 2020-10-05T11:52:21.636 INFO:teuthology.orchestra.run.smithi158.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-10-05T11:52:21.698 INFO:teuthology.orchestra.run.smithi081.stdout:2 upgraded, 110 newly installed, 0 to remove and 0 not upgraded. 2020-10-05T11:52:21.699 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 167 MB of archives. 2020-10-05T11:52:21.699 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 779 MB of additional disk space will be used. 2020-10-05T11:52:21.699 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 16.0.0-6145-gb726425d-1bionic [1,867 kB] 2020-10-05T11:52:21.718 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-10-05T11:52:21.726 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-10-05T11:52:21.785 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 16.0.0-6145-gb726425d-1bionic [3,171 kB] 2020-10-05T11:52:21.807 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-10-05T11:52:21.907 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 16.0.0-6145-gb726425d-1bionic [474 kB] 2020-10-05T11:52:21.922 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 16.0.0-6145-gb726425d-1bionic [327 kB] 2020-10-05T11:52:21.932 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 16.0.0-6145-gb726425d-1bionic [20.6 kB] 2020-10-05T11:52:21.933 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 16.0.0-6145-gb726425d-1bionic [168 kB] 2020-10-05T11:52:21.938 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 16.0.0-6145-gb726425d-1bionic [27.7 kB] 2020-10-05T11:52:21.939 INFO:teuthology.orchestra.run.smithi158.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 16.0.0-6145-gb726425d-1bionic [312 kB] 2020-10-05T11:52:21.950 INFO:teuthology.orchestra.run.smithi158.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 16.0.0-6145-gb726425d-1bionic [3,131 kB] 2020-10-05T11:52:21.976 INFO:teuthology.orchestra.run.smithi158.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-10-05T11:52:21.990 INFO:teuthology.orchestra.run.smithi158.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-10-05T11:52:22.012 INFO:teuthology.orchestra.run.smithi158.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-10-05T11:52:22.056 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-10-05T11:52:22.057 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-10-05T11:52:22.059 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-10-05T11:52:22.075 INFO:teuthology.orchestra.run.smithi158.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 16.0.0-6145-gb726425d-1bionic [99.1 kB] 2020-10-05T11:52:22.078 INFO:teuthology.orchestra.run.smithi158.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 16.0.0-6145-gb726425d-1bionic [414 kB] 2020-10-05T11:52:22.091 INFO:teuthology.orchestra.run.smithi158.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 16.0.0-6145-gb726425d-1bionic [20.4 MB] 2020-10-05T11:52:22.112 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 16.0.0-6145-gb726425d-1bionic [3,171 kB] 2020-10-05T11:52:22.117 INFO:teuthology.orchestra.run.smithi158.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-10-05T11:52:22.121 INFO:teuthology.orchestra.run.smithi158.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-10-05T11:52:22.148 INFO:teuthology.orchestra.run.smithi158.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-10-05T11:52:22.156 INFO:teuthology.orchestra.run.smithi158.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-10-05T11:52:22.164 INFO:teuthology.orchestra.run.smithi158.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-10-05T11:52:22.175 INFO:teuthology.orchestra.run.smithi158.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-10-05T11:52:22.176 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-10-05T11:52:22.179 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-10-05T11:52:22.183 INFO:teuthology.orchestra.run.smithi158.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2020-10-05T11:52:22.209 INFO:teuthology.orchestra.run.smithi158.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-10-05T11:52:22.214 INFO:teuthology.orchestra.run.smithi158.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-10-05T11:52:22.221 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-10-05T11:52:22.221 INFO:teuthology.orchestra.run.smithi158.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-10-05T11:52:22.229 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-10-05T11:52:22.234 INFO:teuthology.orchestra.run.smithi158.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-10-05T11:52:22.239 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-10-05T11:52:22.251 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-10-05T11:52:22.260 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2020-10-05T11:52:22.283 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-10-05T11:52:22.290 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-10-05T11:52:22.301 INFO:teuthology.orchestra.run.smithi158.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-10-05T11:52:22.302 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-10-05T11:52:22.302 INFO:teuthology.orchestra.run.smithi158.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-10-05T11:52:22.309 INFO:teuthology.orchestra.run.smithi158.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-10-05T11:52:22.309 INFO:teuthology.orchestra.run.smithi158.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-10-05T11:52:22.309 INFO:teuthology.orchestra.run.smithi158.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-10-05T11:52:22.309 INFO:teuthology.orchestra.run.smithi158.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-10-05T11:52:22.309 INFO:teuthology.orchestra.run.smithi158.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-10-05T11:52:22.312 INFO:teuthology.orchestra.run.smithi158.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-10-05T11:52:22.314 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-10-05T11:52:22.315 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-10-05T11:52:22.381 INFO:teuthology.orchestra.run.smithi158.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-10-05T11:52:22.382 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-10-05T11:52:22.383 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-10-05T11:52:22.383 INFO:teuthology.orchestra.run.smithi158.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-10-05T11:52:22.385 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-10-05T11:52:22.386 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-10-05T11:52:22.386 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-10-05T11:52:22.389 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-10-05T11:52:22.392 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-10-05T11:52:22.462 INFO:teuthology.orchestra.run.smithi158.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-10-05T11:52:22.462 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-10-05T11:52:22.463 INFO:teuthology.orchestra.run.smithi158.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-10-05T11:52:22.463 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-10-05T11:52:22.463 INFO:teuthology.orchestra.run.smithi158.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-10-05T11:52:22.464 INFO:teuthology.orchestra.run.smithi158.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-10-05T11:52:22.467 INFO:teuthology.orchestra.run.smithi158.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-10-05T11:52:22.474 INFO:teuthology.orchestra.run.smithi158.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2020-10-05T11:52:22.478 INFO:teuthology.orchestra.run.smithi158.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-10-05T11:52:22.479 INFO:teuthology.orchestra.run.smithi158.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-10-05T11:52:22.483 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-10-05T11:52:22.542 INFO:teuthology.orchestra.run.smithi158.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-10-05T11:52:22.542 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-10-05T11:52:22.543 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-10-05T11:52:22.544 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-10-05T11:52:22.547 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-10-05T11:52:22.555 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2020-10-05T11:52:22.555 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 16.0.0-6145-gb726425d-1bionic [474 kB] 2020-10-05T11:52:22.559 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-10-05T11:52:22.560 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-10-05T11:52:22.623 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-10-05T11:52:22.625 INFO:teuthology.orchestra.run.smithi158.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-10-05T11:52:22.625 INFO:teuthology.orchestra.run.smithi158.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-10-05T11:52:22.670 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 16.0.0-6145-gb726425d-1bionic [327 kB] 2020-10-05T11:52:22.682 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 16.0.0-6145-gb726425d-1bionic [20.6 kB] 2020-10-05T11:52:22.683 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 16.0.0-6145-gb726425d-1bionic [168 kB] 2020-10-05T11:52:22.708 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-10-05T11:52:22.709 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-10-05T11:52:22.739 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 16.0.0-6145-gb726425d-1bionic [27.7 kB] 2020-10-05T11:52:22.740 INFO:teuthology.orchestra.run.smithi081.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 16.0.0-6145-gb726425d-1bionic [312 kB] 2020-10-05T11:52:22.801 INFO:teuthology.orchestra.run.smithi081.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 16.0.0-6145-gb726425d-1bionic [3,131 kB] 2020-10-05T11:52:22.915 INFO:teuthology.orchestra.run.smithi158.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-10-05T11:52:22.945 INFO:teuthology.orchestra.run.smithi158.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 16.0.0-6145-gb726425d-1bionic [5,627 kB] 2020-10-05T11:52:22.950 INFO:teuthology.orchestra.run.smithi158.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-10-05T11:52:22.953 INFO:teuthology.orchestra.run.smithi158.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-10-05T11:52:22.988 INFO:teuthology.orchestra.run.smithi081.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-10-05T11:52:22.993 INFO:teuthology.orchestra.run.smithi158.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-10-05T11:52:22.993 INFO:teuthology.orchestra.run.smithi158.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-10-05T11:52:22.994 INFO:teuthology.orchestra.run.smithi158.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2020-10-05T11:52:22.995 INFO:teuthology.orchestra.run.smithi158.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-10-05T11:52:22.996 INFO:teuthology.orchestra.run.smithi158.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-10-05T11:52:22.997 INFO:teuthology.orchestra.run.smithi158.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-10-05T11:52:22.998 INFO:teuthology.orchestra.run.smithi158.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-10-05T11:52:23.033 INFO:teuthology.orchestra.run.smithi081.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-10-05T11:52:23.034 INFO:teuthology.orchestra.run.smithi081.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-10-05T11:52:23.070 INFO:teuthology.orchestra.run.smithi081.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-10-05T11:52:23.070 INFO:teuthology.orchestra.run.smithi081.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-10-05T11:52:23.071 INFO:teuthology.orchestra.run.smithi081.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2020-10-05T11:52:23.071 INFO:teuthology.orchestra.run.smithi081.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-10-05T11:52:23.071 INFO:teuthology.orchestra.run.smithi081.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-10-05T11:52:23.072 INFO:teuthology.orchestra.run.smithi081.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-10-05T11:52:23.072 INFO:teuthology.orchestra.run.smithi081.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-10-05T11:52:23.076 INFO:teuthology.orchestra.run.smithi158.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-10-05T11:52:23.079 INFO:teuthology.orchestra.run.smithi158.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-10-05T11:52:23.084 INFO:teuthology.orchestra.run.smithi158.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-10-05T11:52:23.085 INFO:teuthology.orchestra.run.smithi158.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-10-05T11:52:23.087 INFO:teuthology.orchestra.run.smithi158.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2020-10-05T11:52:23.150 INFO:teuthology.orchestra.run.smithi081.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-10-05T11:52:23.151 INFO:teuthology.orchestra.run.smithi081.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-10-05T11:52:23.157 INFO:teuthology.orchestra.run.smithi158.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2020-10-05T11:52:23.158 INFO:teuthology.orchestra.run.smithi158.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-10-05T11:52:23.161 INFO:teuthology.orchestra.run.smithi158.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-10-05T11:52:23.164 INFO:teuthology.orchestra.run.smithi158.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-10-05T11:52:23.165 INFO:teuthology.orchestra.run.smithi158.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-10-05T11:52:23.167 INFO:teuthology.orchestra.run.smithi158.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 16.0.0-6145-gb726425d-1bionic [158 kB] 2020-10-05T11:52:23.171 INFO:teuthology.orchestra.run.smithi158.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 16.0.0-6145-gb726425d-1bionic [1,370 kB] 2020-10-05T11:52:23.230 INFO:teuthology.orchestra.run.smithi158.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 16.0.0-6145-gb726425d-1bionic [6,640 kB] 2020-10-05T11:52:23.230 INFO:teuthology.orchestra.run.smithi081.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-10-05T11:52:23.231 INFO:teuthology.orchestra.run.smithi081.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-10-05T11:52:23.236 INFO:teuthology.orchestra.run.smithi081.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2020-10-05T11:52:23.237 INFO:teuthology.orchestra.run.smithi158.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-10-05T11:52:23.237 INFO:teuthology.orchestra.run.smithi081.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2020-10-05T11:52:23.237 INFO:teuthology.orchestra.run.smithi081.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-10-05T11:52:23.241 INFO:teuthology.orchestra.run.smithi081.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-10-05T11:52:23.242 INFO:teuthology.orchestra.run.smithi081.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-10-05T11:52:23.242 INFO:teuthology.orchestra.run.smithi081.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-10-05T11:52:23.243 INFO:teuthology.orchestra.run.smithi158.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-10-05T11:52:23.249 INFO:teuthology.orchestra.run.smithi158.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 nvme-cli amd64 1.5-1ubuntu1 [183 kB] 2020-10-05T11:52:23.254 INFO:teuthology.orchestra.run.smithi158.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-10-05T11:52:23.254 INFO:teuthology.orchestra.run.smithi158.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-10-05T11:52:23.310 INFO:teuthology.orchestra.run.smithi081.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-10-05T11:52:23.314 INFO:teuthology.orchestra.run.smithi081.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-10-05T11:52:23.316 INFO:teuthology.orchestra.run.smithi158.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-10-05T11:52:23.317 INFO:teuthology.orchestra.run.smithi158.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-10-05T11:52:23.319 INFO:teuthology.orchestra.run.smithi158.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-10-05T11:52:23.322 INFO:teuthology.orchestra.run.smithi158.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-10-05T11:52:23.323 INFO:teuthology.orchestra.run.smithi158.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-10-05T11:52:23.324 INFO:teuthology.orchestra.run.smithi081.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 16.0.0-6145-gb726425d-1bionic [99.1 kB] 2020-10-05T11:52:23.328 INFO:teuthology.orchestra.run.smithi081.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 16.0.0-6145-gb726425d-1bionic [414 kB] 2020-10-05T11:52:23.390 INFO:teuthology.orchestra.run.smithi081.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 nvme-cli amd64 1.5-1ubuntu1 [183 kB] 2020-10-05T11:52:23.395 INFO:teuthology.orchestra.run.smithi081.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 16.0.0-6145-gb726425d-1bionic [20.4 MB] 2020-10-05T11:52:23.396 INFO:teuthology.orchestra.run.smithi081.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-10-05T11:52:23.397 INFO:teuthology.orchestra.run.smithi158.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-10-05T11:52:23.397 INFO:teuthology.orchestra.run.smithi081.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-10-05T11:52:23.397 INFO:teuthology.orchestra.run.smithi158.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-10-05T11:52:23.398 INFO:teuthology.orchestra.run.smithi081.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-10-05T11:52:23.398 INFO:teuthology.orchestra.run.smithi081.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-10-05T11:52:23.399 INFO:teuthology.orchestra.run.smithi081.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-10-05T11:52:23.400 INFO:teuthology.orchestra.run.smithi158.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-10-05T11:52:23.403 INFO:teuthology.orchestra.run.smithi081.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-10-05T11:52:23.403 INFO:teuthology.orchestra.run.smithi081.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-10-05T11:52:23.421 INFO:teuthology.orchestra.run.smithi158.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-10-05T11:52:23.421 INFO:teuthology.orchestra.run.smithi158.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-10-05T11:52:23.471 INFO:teuthology.orchestra.run.smithi081.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-10-05T11:52:23.471 INFO:teuthology.orchestra.run.smithi081.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-10-05T11:52:23.476 INFO:teuthology.orchestra.run.smithi158.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-10-05T11:52:23.503 INFO:teuthology.orchestra.run.smithi158.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 16.0.0-6145-gb726425d-1bionic [24.6 MB] 2020-10-05T11:52:23.551 INFO:teuthology.orchestra.run.smithi081.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-10-05T11:52:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-10-05T11:52:23.571 INFO:teuthology.orchestra.run.smithi081.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-10-05T11:52:23.571 INFO:teuthology.orchestra.run.smithi081.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-10-05T11:52:23.580 INFO:teuthology.orchestra.run.smithi158.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-10-05T11:52:23.581 INFO:teuthology.orchestra.run.smithi158.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-10-05T11:52:23.581 INFO:teuthology.orchestra.run.smithi158.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.3 [330 kB] 2020-10-05T11:52:23.586 INFO:teuthology.orchestra.run.smithi158.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-10-05T11:52:23.586 INFO:teuthology.orchestra.run.smithi158.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-10-05T11:52:23.587 INFO:teuthology.orchestra.run.smithi158.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-10-05T11:52:23.587 INFO:teuthology.orchestra.run.smithi158.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-10-05T11:52:23.589 INFO:teuthology.orchestra.run.smithi158.stdout:Get:98 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-10-05T11:52:23.589 INFO:teuthology.orchestra.run.smithi158.stdout:Get:99 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-10-05T11:52:23.662 INFO:teuthology.orchestra.run.smithi081.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-10-05T11:52:23.662 INFO:teuthology.orchestra.run.smithi081.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-10-05T11:52:23.663 INFO:teuthology.orchestra.run.smithi081.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.3 [330 kB] 2020-10-05T11:52:23.719 INFO:teuthology.orchestra.run.smithi081.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-10-05T11:52:23.719 INFO:teuthology.orchestra.run.smithi081.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-10-05T11:52:23.721 INFO:teuthology.orchestra.run.smithi081.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-10-05T11:52:23.721 INFO:teuthology.orchestra.run.smithi081.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-10-05T11:52:23.723 INFO:teuthology.orchestra.run.smithi081.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-10-05T11:52:23.723 INFO:teuthology.orchestra.run.smithi081.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-10-05T11:52:24.519 INFO:teuthology.orchestra.run.smithi158.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 16.0.0-6145-gb726425d-1bionic [3,808 B] 2020-10-05T11:52:24.519 INFO:teuthology.orchestra.run.smithi158.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 16.0.0-6145-gb726425d-1bionic [558 kB] 2020-10-05T11:52:24.547 INFO:teuthology.orchestra.run.smithi158.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 16.0.0-6145-gb726425d-1bionic [1,971 kB] 2020-10-05T11:52:24.628 INFO:teuthology.orchestra.run.smithi158.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 16.0.0-6145-gb726425d-1bionic [51.3 kB] 2020-10-05T11:52:24.629 INFO:teuthology.orchestra.run.smithi158.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 16.0.0-6145-gb726425d-1bionic [55.6 kB] 2020-10-05T11:52:24.631 INFO:teuthology.orchestra.run.smithi158.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 16.0.0-6145-gb726425d-1bionic [2,869 kB] 2020-10-05T11:52:24.741 INFO:teuthology.orchestra.run.smithi158.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 16.0.0-6145-gb726425d-1bionic [7,886 kB] 2020-10-05T11:52:25.078 INFO:teuthology.orchestra.run.smithi158.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 16.0.0-6145-gb726425d-1bionic [3,928 B] 2020-10-05T11:52:25.078 INFO:teuthology.orchestra.run.smithi158.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 16.0.0-6145-gb726425d-1bionic [22.3 kB] 2020-10-05T11:52:25.078 INFO:teuthology.orchestra.run.smithi158.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 16.0.0-6145-gb726425d-1bionic [49.3 MB] 2020-10-05T11:52:26.663 INFO:teuthology.orchestra.run.smithi081.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 16.0.0-6145-gb726425d-1bionic [5,627 kB] 2020-10-05T11:52:27.144 INFO:teuthology.orchestra.run.smithi158.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 16.0.0-6145-gb726425d-1bionic [19.2 kB] 2020-10-05T11:52:27.144 INFO:teuthology.orchestra.run.smithi158.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 16.0.0-6145-gb726425d-1bionic [9,628 kB] 2020-10-05T11:52:27.375 INFO:teuthology.orchestra.run.smithi081.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 16.0.0-6145-gb726425d-1bionic [158 kB] 2020-10-05T11:52:27.378 INFO:teuthology.orchestra.run.smithi081.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 16.0.0-6145-gb726425d-1bionic [1,370 kB] 2020-10-05T11:52:27.558 INFO:teuthology.orchestra.run.smithi158.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 16.0.0-6145-gb726425d-1bionic [76.3 kB] 2020-10-05T11:52:27.565 INFO:teuthology.orchestra.run.smithi081.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 16.0.0-6145-gb726425d-1bionic [6,640 kB] 2020-10-05T11:52:27.864 INFO:teuthology.orchestra.run.smithi081.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 16.0.0-6145-gb726425d-1bionic [24.6 MB] 2020-10-05T11:52:28.250 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 167 MB in 6s (27.5 MB/s) 2020-10-05T11:52:28.393 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-uritemplate. 2020-10-05T11:52:28.428 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102061 files and directories currently installed.) 2020-10-05T11:52:28.431 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../000-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-10-05T11:52:28.474 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-10-05T11:52:28.744 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-10-05T11:52:28.757 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-10-05T11:52:28.819 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-10-05T11:52:28.974 INFO:teuthology.orchestra.run.smithi081.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 16.0.0-6145-gb726425d-1bionic [3,808 B] 2020-10-05T11:52:28.975 INFO:teuthology.orchestra.run.smithi081.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 16.0.0-6145-gb726425d-1bionic [558 kB] 2020-10-05T11:52:28.998 INFO:teuthology.orchestra.run.smithi081.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 16.0.0-6145-gb726425d-1bionic [1,971 kB] 2020-10-05T11:52:29.088 INFO:teuthology.orchestra.run.smithi081.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 16.0.0-6145-gb726425d-1bionic [51.3 kB] 2020-10-05T11:52:29.089 INFO:teuthology.orchestra.run.smithi081.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 16.0.0-6145-gb726425d-1bionic [55.6 kB] 2020-10-05T11:52:29.091 INFO:teuthology.orchestra.run.smithi081.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 16.0.0-6145-gb726425d-1bionic [2,869 kB] 2020-10-05T11:52:29.143 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../002-librbd1_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:29.216 INFO:teuthology.orchestra.run.smithi081.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 16.0.0-6145-gb726425d-1bionic [7,886 kB] 2020-10-05T11:52:29.248 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librbd1 (16.0.0-6145-gb726425d-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-10-05T11:52:29.576 INFO:teuthology.orchestra.run.smithi081.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 16.0.0-6145-gb726425d-1bionic [3,928 B] 2020-10-05T11:52:29.576 INFO:teuthology.orchestra.run.smithi081.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 16.0.0-6145-gb726425d-1bionic [22.3 kB] 2020-10-05T11:52:29.577 INFO:teuthology.orchestra.run.smithi081.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 16.0.0-6145-gb726425d-1bionic [49.3 MB] 2020-10-05T11:52:29.788 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../003-librados2_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:29.894 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librados2 (16.0.0-6145-gb726425d-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-10-05T11:52:30.506 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libcephfs2. 2020-10-05T11:52:30.519 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../004-libcephfs2_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:30.548 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libcephfs2 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:30.817 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rados. 2020-10-05T11:52:30.829 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../005-python3-rados_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:30.867 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rados (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:31.178 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-10-05T11:52:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../006-python3-ceph-argparse_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:52:31.219 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-ceph-argparse (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:31.463 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cephfs. 2020-10-05T11:52:31.474 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../007-python3-cephfs_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:31.505 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cephfs (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:31.774 INFO:teuthology.orchestra.run.smithi081.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 16.0.0-6145-gb726425d-1bionic [19.2 kB] 2020-10-05T11:52:31.775 INFO:teuthology.orchestra.run.smithi081.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 16.0.0-6145-gb726425d-1bionic [9,628 kB] 2020-10-05T11:52:31.799 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-ceph-common. 2020-10-05T11:52:31.809 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../008-python3-ceph-common_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:52:31.841 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-ceph-common (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:32.086 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-prettytable. 2020-10-05T11:52:32.098 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../009-python3-prettytable_0.7.2-3_all.deb ... 2020-10-05T11:52:32.136 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-10-05T11:52:32.250 INFO:teuthology.orchestra.run.smithi081.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuval-static-analysis/b726425d5bff271f4fe469ee94a9b80f7cad00ba/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 16.0.0-6145-gb726425d-1bionic [76.3 kB] 2020-10-05T11:52:32.371 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rbd. 2020-10-05T11:52:32.388 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../010-python3-rbd_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:32.422 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rbd (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:32.724 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-10-05T11:52:32.735 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../011-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-10-05T11:52:32.786 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-10-05T11:52:32.936 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 167 MB in 11s (15.6 MB/s) 2020-10-05T11:52:33.061 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-10-05T11:52:33.074 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../012-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-10-05T11:52:33.080 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-uritemplate. 2020-10-05T11:52:33.102 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-10-05T11:52:33.116 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102061 files and directories currently installed.) 2020-10-05T11:52:33.119 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../000-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-10-05T11:52:33.162 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-10-05T11:52:33.439 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librgw2. 2020-10-05T11:52:33.450 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../013-librgw2_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:33.464 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-10-05T11:52:33.477 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-10-05T11:52:33.489 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librgw2 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:33.557 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-10-05T11:52:33.905 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../002-librbd1_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:34.008 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rgw. 2020-10-05T11:52:34.021 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../014-python3-rgw_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:34.027 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librbd1 (16.0.0-6145-gb726425d-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-10-05T11:52:34.073 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rgw (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:34.335 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-10-05T11:52:34.348 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../015-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-10-05T11:52:34.377 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-10-05T11:52:34.569 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../003-librados2_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:34.630 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-10-05T11:52:34.642 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../016-libleveldb1v5_1.20-2_amd64.deb ... 2020-10-05T11:52:34.680 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-10-05T11:52:34.690 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librados2 (16.0.0-6145-gb726425d-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-10-05T11:52:35.016 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liboath0. 2020-10-05T11:52:35.029 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../017-liboath0_2.6.1-1_amd64.deb ... 2020-10-05T11:52:35.058 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-10-05T11:52:35.319 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs2. 2020-10-05T11:52:35.319 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libradosstriper1. 2020-10-05T11:52:35.330 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../004-libcephfs2_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:35.331 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../018-libradosstriper1_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:35.368 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs2 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:35.393 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libradosstriper1 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:35.663 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rados. 2020-10-05T11:52:35.674 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../005-python3-rados_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:35.713 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rados (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:35.763 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-common. 2020-10-05T11:52:35.776 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../019-ceph-common_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:35.813 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-common (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:36.065 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-10-05T11:52:36.076 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../006-python3-ceph-argparse_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:52:36.115 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-argparse (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:36.393 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cephfs. 2020-10-05T11:52:36.404 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../007-python3-cephfs_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:36.452 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cephfs (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:36.762 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-common. 2020-10-05T11:52:36.774 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../008-python3-ceph-common_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:52:36.812 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-common (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:37.124 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-prettytable. 2020-10-05T11:52:37.135 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../009-python3-prettytable_0.7.2-3_all.deb ... 2020-10-05T11:52:37.174 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-10-05T11:52:37.452 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rbd. 2020-10-05T11:52:37.463 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../010-python3-rbd_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:37.502 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rbd (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:37.585 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-base. 2020-10-05T11:52:37.597 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../020-ceph-base_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:37.636 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-base (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:37.846 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-10-05T11:52:37.857 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../011-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-10-05T11:52:37.888 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-10-05T11:52:38.217 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-10-05T11:52:38.228 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../012-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-10-05T11:52:38.267 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-10-05T11:52:38.540 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-dateutil. 2020-10-05T11:52:38.552 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../021-python3-dateutil_2.6.1-1_all.deb ... 2020-10-05T11:52:38.581 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-10-05T11:52:38.603 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librgw2. 2020-10-05T11:52:38.615 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../013-librgw2_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:38.653 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librgw2 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:38.893 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-asn1crypto. 2020-10-05T11:52:38.903 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../022-python3-asn1crypto_0.24.0-1_all.deb ... 2020-10-05T11:52:38.943 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-10-05T11:52:39.172 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rgw. 2020-10-05T11:52:39.183 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../014-python3-rgw_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:39.206 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cffi-backend. 2020-10-05T11:52:39.217 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../023-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-10-05T11:52:39.222 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rgw (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:39.248 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-10-05T11:52:39.524 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-10-05T11:52:39.537 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../015-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-10-05T11:52:39.574 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-10-05T11:52:39.575 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cryptography. 2020-10-05T11:52:39.587 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../024-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2020-10-05T11:52:39.625 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-10-05T11:52:39.854 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-10-05T11:52:39.865 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../016-libleveldb1v5_1.20-2_amd64.deb ... 2020-10-05T11:52:39.905 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-10-05T11:52:39.963 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-openssl. 2020-10-05T11:52:39.975 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../025-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-10-05T11:52:40.004 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-10-05T11:52:40.274 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liboath0. 2020-10-05T11:52:40.282 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-10-05T11:52:40.286 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../017-liboath0_2.6.1-1_amd64.deb ... 2020-10-05T11:52:40.295 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:52:40.324 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-10-05T11:52:40.333 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-modules-core (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:40.635 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libradosstriper1. 2020-10-05T11:52:40.647 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../018-libradosstriper1_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:40.685 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libradosstriper1 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:40.688 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-bcrypt. 2020-10-05T11:52:40.700 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-10-05T11:52:40.737 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-10-05T11:52:41.041 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cherrypy3. 2020-10-05T11:52:41.053 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-2_all.deb ... 2020-10-05T11:52:41.091 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-10-05T11:52:41.113 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-common. 2020-10-05T11:52:41.125 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../019-ceph-common_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:41.163 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-common (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:41.421 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-jwt. 2020-10-05T11:52:41.433 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../029-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-10-05T11:52:41.471 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-10-05T11:52:41.741 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-logutils. 2020-10-05T11:52:41.753 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-5_all.deb ... 2020-10-05T11:52:41.791 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-10-05T11:52:42.110 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-markupsafe. 2020-10-05T11:52:42.123 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../031-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-10-05T11:52:42.161 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-10-05T11:52:42.468 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-mako. 2020-10-05T11:52:42.474 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../032-python3-mako_1.0.7+ds1-1_all.deb ... 2020-10-05T11:52:42.513 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-10-05T11:52:42.841 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-simplegeneric. 2020-10-05T11:52:42.853 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-1_all.deb ... 2020-10-05T11:52:42.891 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-10-05T11:52:43.035 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-base. 2020-10-05T11:52:43.046 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../020-ceph-base_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:43.094 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-base (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:43.185 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-singledispatch. 2020-10-05T11:52:43.196 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-10-05T11:52:43.227 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-10-05T11:52:43.504 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-webob. 2020-10-05T11:52:43.517 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../035-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-10-05T11:52:43.554 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-10-05T11:52:43.874 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-bs4. 2020-10-05T11:52:43.887 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../036-python3-bs4_4.6.0-1_all.deb ... 2020-10-05T11:52:43.924 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-10-05T11:52:43.982 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-dateutil. 2020-10-05T11:52:43.992 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../021-python3-dateutil_2.6.1-1_all.deb ... 2020-10-05T11:52:44.023 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-10-05T11:52:44.243 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-waitress. 2020-10-05T11:52:44.254 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../037-python3-waitress_1.0.1-1_all.deb ... 2020-10-05T11:52:44.293 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-10-05T11:52:44.335 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-asn1crypto. 2020-10-05T11:52:44.345 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../022-python3-asn1crypto_0.24.0-1_all.deb ... 2020-10-05T11:52:44.387 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-10-05T11:52:44.638 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-tempita. 2020-10-05T11:52:44.649 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../038-python3-tempita_0.5.2-2_all.deb ... 2020-10-05T11:52:44.673 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cffi-backend. 2020-10-05T11:52:44.684 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../023-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-10-05T11:52:44.688 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-10-05T11:52:44.723 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-10-05T11:52:45.017 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cryptography. 2020-10-05T11:52:45.030 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../024-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2020-10-05T11:52:45.144 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-10-05T11:52:45.332 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-paste. 2020-10-05T11:52:45.345 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../039-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-10-05T11:52:45.382 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-10-05T11:52:45.597 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-openssl. 2020-10-05T11:52:45.609 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../025-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-10-05T11:52:45.647 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-10-05T11:52:45.715 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-10-05T11:52:45.728 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../040-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-10-05T11:52:45.760 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-10-05T11:52:45.916 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-10-05T11:52:45.927 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:52:45.966 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-modules-core (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:46.063 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pastedeploy. 2020-10-05T11:52:46.074 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../041-python3-pastedeploy_1.5.2-4_all.deb ... 2020-10-05T11:52:46.113 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-10-05T11:52:46.322 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bcrypt. 2020-10-05T11:52:46.334 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-10-05T11:52:46.372 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-10-05T11:52:46.391 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-webtest. 2020-10-05T11:52:46.403 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../042-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-10-05T11:52:46.433 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-10-05T11:52:46.675 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cherrypy3. 2020-10-05T11:52:46.687 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-2_all.deb ... 2020-10-05T11:52:46.726 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-10-05T11:52:46.770 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pecan. 2020-10-05T11:52:46.781 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../043-python3-pecan_1.2.1-2_all.deb ... 2020-10-05T11:52:46.820 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-10-05T11:52:47.022 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jwt. 2020-10-05T11:52:47.035 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../029-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-10-05T11:52:47.064 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-10-05T11:52:47.194 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-werkzeug. 2020-10-05T11:52:47.207 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../044-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-10-05T11:52:47.244 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-10-05T11:52:47.375 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-logutils. 2020-10-05T11:52:47.387 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-5_all.deb ... 2020-10-05T11:52:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-10-05T11:52:47.597 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr. 2020-10-05T11:52:47.610 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../045-ceph-mgr_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:47.647 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:47.720 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-markupsafe. 2020-10-05T11:52:47.733 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../031-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-10-05T11:52:47.778 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-10-05T11:52:48.073 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-mako. 2020-10-05T11:52:48.086 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../032-python3-mako_1.0.7+ds1-1_all.deb ... 2020-10-05T11:52:48.123 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-10-05T11:52:48.125 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mon. 2020-10-05T11:52:48.138 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../046-ceph-mon_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:48.167 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mon (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:48.426 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplegeneric. 2020-10-05T11:52:48.438 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-1_all.deb ... 2020-10-05T11:52:48.467 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-10-05T11:52:48.753 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-singledispatch. 2020-10-05T11:52:48.766 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-10-05T11:52:48.804 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-10-05T11:52:49.106 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webob. 2020-10-05T11:52:49.117 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../035-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-10-05T11:52:49.137 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-osd. 2020-10-05T11:52:49.149 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../047-ceph-osd_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:49.181 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-10-05T11:52:49.187 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-osd (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:49.501 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bs4. 2020-10-05T11:52:49.512 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../036-python3-bs4_4.6.0-1_all.deb ... 2020-10-05T11:52:49.551 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-10-05T11:52:49.862 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-waitress. 2020-10-05T11:52:49.874 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../037-python3-waitress_1.0.1-1_all.deb ... 2020-10-05T11:52:49.912 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-10-05T11:52:50.432 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempita. 2020-10-05T11:52:50.444 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../038-python3-tempita_0.5.2-2_all.deb ... 2020-10-05T11:52:50.482 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-10-05T11:52:50.760 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-paste. 2020-10-05T11:52:50.771 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../039-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-10-05T11:52:50.809 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-10-05T11:52:51.130 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-10-05T11:52:51.141 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../040-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-10-05T11:52:51.142 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph. 2020-10-05T11:52:51.155 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../048-ceph_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:51.180 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-10-05T11:52:51.192 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:51.474 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastedeploy. 2020-10-05T11:52:51.486 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../041-python3-pastedeploy_1.5.2-4_all.deb ... 2020-10-05T11:52:51.512 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-fuse. 2020-10-05T11:52:51.523 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../049-ceph-fuse_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:51.524 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-10-05T11:52:51.561 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-fuse (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:51.828 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webtest. 2020-10-05T11:52:51.839 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../042-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-10-05T11:52:51.878 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-10-05T11:52:51.956 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mds. 2020-10-05T11:52:51.968 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../050-ceph-mds_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mds (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:52.198 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pecan. 2020-10-05T11:52:52.210 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../043-python3-pecan_1.2.1-2_all.deb ... 2020-10-05T11:52:52.247 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-10-05T11:52:52.502 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package cephadm. 2020-10-05T11:52:52.514 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../051-cephadm_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:52.552 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking cephadm (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:52.622 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-werkzeug. 2020-10-05T11:52:52.634 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../044-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-10-05T11:52:52.664 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-10-05T11:52:52.871 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-jinja2. 2020-10-05T11:52:52.884 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../052-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-10-05T11:52:52.922 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-10-05T11:52:53.059 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr. 2020-10-05T11:52:53.072 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../045-ceph-mgr_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:53.108 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:53.235 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-10-05T11:52:53.247 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../053-ceph-mgr-cephadm_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:52:53.276 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-cephadm (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:53.587 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mon. 2020-10-05T11:52:53.599 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../046-ceph-mon_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:53.613 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-repoze.lru. 2020-10-05T11:52:53.625 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../054-python3-repoze.lru_0.7-1_all.deb ... 2020-10-05T11:52:53.636 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mon (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:53.663 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-10-05T11:52:53.966 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-routes. 2020-10-05T11:52:53.978 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../055-python3-routes_2.4.1-1_all.deb ... 2020-10-05T11:52:54.015 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-10-05T11:52:54.318 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-10-05T11:52:54.331 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:52:54.368 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-dashboard (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:54.540 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-osd. 2020-10-05T11:52:54.551 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../047-ceph-osd_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:54.590 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-osd (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:55.991 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-numpy. 2020-10-05T11:52:56.003 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../057-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-10-05T11:52:56.066 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-10-05T11:52:56.681 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-decorator. 2020-10-05T11:52:56.694 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../058-python3-decorator_4.1.2-1_all.deb ... 2020-10-05T11:52:56.731 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-10-05T11:52:56.862 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph. 2020-10-05T11:52:56.872 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../048-ceph_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:56.912 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:57.042 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-scipy. 2020-10-05T11:52:57.053 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../059-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-10-05T11:52:57.092 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-10-05T11:52:57.215 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-fuse. 2020-10-05T11:52:57.225 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../049-ceph-fuse_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:57.264 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-fuse (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:57.643 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mds. 2020-10-05T11:52:57.655 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../050-ceph-mds_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:57.694 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mds (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:58.181 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephadm. 2020-10-05T11:52:58.192 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../051-cephadm_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:52:58.224 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-10-05T11:52:58.231 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephadm (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:58.235 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../060-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-10-05T11:52:58.274 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-10-05T11:52:58.500 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jinja2. 2020-10-05T11:52:58.513 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../052-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-10-05T11:52:58.550 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-10-05T11:52:58.744 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-joblib. 2020-10-05T11:52:58.758 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../061-python3-joblib_0.11-1_all.deb ... 2020-10-05T11:52:58.802 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-joblib (0.11-1) ... 2020-10-05T11:52:58.845 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-10-05T11:52:58.858 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../053-ceph-mgr-cephadm_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:52:58.895 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-cephadm (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:59.148 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-sklearn. 2020-10-05T11:52:59.160 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../062-python3-sklearn_0.19.1-3_all.deb ... 2020-10-05T11:52:59.215 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-repoze.lru. 2020-10-05T11:52:59.222 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-10-05T11:52:59.227 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../054-python3-repoze.lru_0.7-1_all.deb ... 2020-10-05T11:52:59.265 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-10-05T11:52:59.568 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-routes. 2020-10-05T11:52:59.581 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../055-python3-routes_2.4.1-1_all.deb ... 2020-10-05T11:52:59.618 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-10-05T11:52:59.749 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-10-05T11:52:59.762 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:52:59.799 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-diskprediction-local (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:52:59.929 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-10-05T11:52:59.942 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:52:59.979 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-dashboard (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:00.886 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-monotonic. 2020-10-05T11:53:00.889 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-numpy. 2020-10-05T11:53:00.899 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../064-python3-monotonic_1.1-2_all.deb ... 2020-10-05T11:53:00.902 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../057-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-10-05T11:53:00.944 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-10-05T11:53:00.947 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-10-05T11:53:01.272 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-fasteners. 2020-10-05T11:53:01.284 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../065-python3-fasteners_0.12.0-3_all.deb ... 2020-10-05T11:53:01.322 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-10-05T11:53:01.579 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-decorator. 2020-10-05T11:53:01.591 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../058-python3-decorator_4.1.2-1_all.deb ... 2020-10-05T11:53:01.624 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-httplib2. 2020-10-05T11:53:01.629 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-10-05T11:53:01.639 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../066-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2020-10-05T11:53:01.683 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-10-05T11:53:01.940 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-scipy. 2020-10-05T11:53:01.951 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../059-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-10-05T11:53:01.985 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyasn1. 2020-10-05T11:53:01.990 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-10-05T11:53:01.997 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3_all.deb ... 2020-10-05T11:53:02.027 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-10-05T11:53:02.313 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-10-05T11:53:02.325 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-10-05T11:53:02.364 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-10-05T11:53:02.684 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rsa. 2020-10-05T11:53:02.699 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../069-python3-rsa_3.4.2-1_all.deb ... 2020-10-05T11:53:02.733 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-10-05T11:53:03.036 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-10-05T11:53:03.050 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../070-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-10-05T11:53:03.094 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-10-05T11:53:03.164 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-10-05T11:53:03.176 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../060-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-10-05T11:53:03.214 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-10-05T11:53:03.522 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-oauth2client. 2020-10-05T11:53:03.536 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../071-python3-oauth2client_4.1.2-3_all.deb ... 2020-10-05T11:53:03.580 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-10-05T11:53:03.626 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-joblib. 2020-10-05T11:53:03.637 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../061-python3-joblib_0.11-1_all.deb ... 2020-10-05T11:53:03.676 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-joblib (0.11-1) ... 2020-10-05T11:53:03.950 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-setuptools. 2020-10-05T11:53:03.962 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../072-python3-setuptools_39.0.1-2_all.deb ... 2020-10-05T11:53:04.000 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-10-05T11:53:04.029 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn. 2020-10-05T11:53:04.040 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../062-python3-sklearn_0.19.1-3_all.deb ... 2020-10-05T11:53:04.079 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-10-05T11:53:04.395 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-websocket. 2020-10-05T11:53:04.406 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../073-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-10-05T11:53:04.444 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-10-05T11:53:04.607 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-10-05T11:53:04.619 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:53:04.656 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-diskprediction-local (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:04.757 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-kubernetes. 2020-10-05T11:53:04.770 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../074-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-10-05T11:53:04.807 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-10-05T11:53:05.253 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-10-05T11:53:05.265 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../075-ceph-mgr-k8sevents_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:53:05.303 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-k8sevents (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:05.620 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-json-pointer. 2020-10-05T11:53:05.633 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../076-python3-json-pointer_1.10-1_all.deb ... 2020-10-05T11:53:05.670 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-json-pointer (1.10-1) ... 2020-10-05T11:53:05.817 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-monotonic. 2020-10-05T11:53:05.831 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../064-python3-monotonic_1.1-2_all.deb ... 2020-10-05T11:53:05.875 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-10-05T11:53:05.998 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-jsonpatch. 2020-10-05T11:53:06.012 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../077-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2020-10-05T11:53:06.059 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-10-05T11:53:06.145 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-fasteners. 2020-10-05T11:53:06.158 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../065-python3-fasteners_0.12.0-3_all.deb ... 2020-10-05T11:53:06.186 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-10-05T11:53:06.376 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-10-05T11:53:06.389 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../078-ceph-mgr-rook_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:53:06.426 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-rook (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:06.489 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-httplib2. 2020-10-05T11:53:06.501 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../066-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2020-10-05T11:53:06.539 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-10-05T11:53:06.754 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libonig4:amd64. 2020-10-05T11:53:06.767 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../079-libonig4_6.7.0-1_amd64.deb ... 2020-10-05T11:53:06.804 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-10-05T11:53:06.842 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1. 2020-10-05T11:53:06.855 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3_all.deb ... 2020-10-05T11:53:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-10-05T11:53:07.141 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjq1:amd64. 2020-10-05T11:53:07.153 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../080-libjq1_1.5+dfsg-2_amd64.deb ... 2020-10-05T11:53:07.228 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-10-05T11:53:07.235 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-10-05T11:53:07.270 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-10-05T11:53:07.276 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-10-05T11:53:07.562 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package jq. 2020-10-05T11:53:07.574 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../081-jq_1.5+dfsg-2_amd64.deb ... 2020-10-05T11:53:07.581 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rsa. 2020-10-05T11:53:07.594 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../069-python3-rsa_3.4.2-1_all.deb ... 2020-10-05T11:53:07.612 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-10-05T11:53:07.631 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-10-05T11:53:07.873 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package socat. 2020-10-05T11:53:07.885 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../082-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-10-05T11:53:07.915 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-10-05T11:53:07.953 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-10-05T11:53:07.966 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../070-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-10-05T11:53:08.011 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-10-05T11:53:08.285 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-10-05T11:53:08.297 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../083-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-10-05T11:53:08.335 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-10-05T11:53:08.479 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-oauth2client. 2020-10-05T11:53:08.490 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../071-python3-oauth2client_4.1.2-3_all.deb ... 2020-10-05T11:53:08.528 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-10-05T11:53:08.609 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package xmlstarlet. 2020-10-05T11:53:08.622 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../084-xmlstarlet_1.6.1-2_amd64.deb ... 2020-10-05T11:53:08.651 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-10-05T11:53:08.798 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-setuptools. 2020-10-05T11:53:08.809 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../072-python3-setuptools_39.0.1-2_all.deb ... 2020-10-05T11:53:08.840 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-10-05T11:53:09.007 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-test. 2020-10-05T11:53:09.018 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../085-ceph-test_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:53:09.055 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-test (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:09.228 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-websocket. 2020-10-05T11:53:09.239 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../073-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-10-05T11:53:09.278 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-10-05T11:53:09.572 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-kubernetes. 2020-10-05T11:53:09.584 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../074-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-10-05T11:53:09.622 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-10-05T11:53:10.044 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-10-05T11:53:10.058 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../075-ceph-mgr-k8sevents_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:53:10.103 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-k8sevents (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:10.430 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-json-pointer. 2020-10-05T11:53:10.443 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../076-python3-json-pointer_1.10-1_all.deb ... 2020-10-05T11:53:10.480 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-json-pointer (1.10-1) ... 2020-10-05T11:53:10.808 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jsonpatch. 2020-10-05T11:53:10.820 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../077-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2020-10-05T11:53:10.853 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-10-05T11:53:11.153 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-10-05T11:53:11.166 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../078-ceph-mgr-rook_16.0.0-6145-gb726425d-1bionic_all.deb ... 2020-10-05T11:53:11.203 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-rook (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:11.531 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libonig4:amd64. 2020-10-05T11:53:11.543 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../079-libonig4_6.7.0-1_amd64.deb ... 2020-10-05T11:53:11.581 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-10-05T11:53:11.934 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjq1:amd64. 2020-10-05T11:53:11.947 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../080-libjq1_1.5+dfsg-2_amd64.deb ... 2020-10-05T11:53:12.069 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-10-05T11:53:12.355 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package jq. 2020-10-05T11:53:12.366 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../081-jq_1.5+dfsg-2_amd64.deb ... 2020-10-05T11:53:12.405 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-10-05T11:53:12.666 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package socat. 2020-10-05T11:53:12.679 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../082-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-10-05T11:53:12.700 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libcephfs-dev. 2020-10-05T11:53:12.713 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../086-libcephfs-dev_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:53:12.715 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-10-05T11:53:12.750 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libcephfs-dev (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:13.011 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package nvme-cli. 2020-10-05T11:53:13.024 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../087-nvme-cli_1.5-1ubuntu1_amd64.deb ... 2020-10-05T11:53:13.061 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking nvme-cli (1.5-1ubuntu1) ... 2020-10-05T11:53:13.114 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-10-05T11:53:13.127 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../083-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-10-05T11:53:13.165 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-10-05T11:53:13.416 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-attr. 2020-10-05T11:53:13.429 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../088-python-attr_17.4.0-2_all.deb ... 2020-10-05T11:53:13.443 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package xmlstarlet. 2020-10-05T11:53:13.454 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../084-xmlstarlet_1.6.1-2_amd64.deb ... 2020-10-05T11:53:13.466 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-attr (17.4.0-2) ... 2020-10-05T11:53:13.509 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-10-05T11:53:13.719 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-funcsigs. 2020-10-05T11:53:13.733 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../089-python-funcsigs_1.0.2-4_all.deb ... 2020-10-05T11:53:13.777 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-10-05T11:53:13.846 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-test. 2020-10-05T11:53:13.859 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../085-ceph-test_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:53:13.896 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-test (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:14.114 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pluggy. 2020-10-05T11:53:14.126 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../090-python-pluggy_0.6.0-1_all.deb ... 2020-10-05T11:53:14.164 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-10-05T11:53:14.458 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-py. 2020-10-05T11:53:14.470 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../091-python-py_1.5.2-1_all.deb ... 2020-10-05T11:53:14.508 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-py (1.5.2-1) ... 2020-10-05T11:53:14.828 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pytest. 2020-10-05T11:53:14.842 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../092-python-pytest_3.3.2-2_all.deb ... 2020-10-05T11:53:14.886 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-10-05T11:53:15.248 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-attr. 2020-10-05T11:53:15.261 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../093-python3-attr_17.4.0-2_all.deb ... 2020-10-05T11:53:15.298 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-10-05T11:53:15.601 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cycler. 2020-10-05T11:53:15.613 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../094-python3-cycler_0.10.0-1_all.deb ... 2020-10-05T11:53:15.651 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-10-05T11:53:16.238 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-webencodings. 2020-10-05T11:53:16.250 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../095-python3-webencodings_0.5-2_all.deb ... 2020-10-05T11:53:16.288 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-10-05T11:53:16.616 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-html5lib. 2020-10-05T11:53:16.630 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../096-python3-html5lib_0.999999999-1_all.deb ... 2020-10-05T11:53:16.674 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-10-05T11:53:17.036 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-10-05T11:53:17.048 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../097-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-10-05T11:53:17.085 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-10-05T11:53:17.483 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs-dev. 2020-10-05T11:53:17.495 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../086-libcephfs-dev_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:53:17.533 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs-dev (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:17.539 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyparsing. 2020-10-05T11:53:17.552 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../098-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-10-05T11:53:17.589 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-10-05T11:53:17.794 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package nvme-cli. 2020-10-05T11:53:17.808 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../087-nvme-cli_1.5-1ubuntu1_amd64.deb ... 2020-10-05T11:53:17.852 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking nvme-cli (1.5-1ubuntu1) ... 2020-10-05T11:53:17.969 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-tz. 2020-10-05T11:53:17.981 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../099-python3-tz_2018.3-2_all.deb ... 2020-10-05T11:53:18.019 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-tz (2018.3-2) ... 2020-10-05T11:53:18.190 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-attr. 2020-10-05T11:53:18.204 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../088-python-attr_17.4.0-2_all.deb ... 2020-10-05T11:53:18.248 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-attr (17.4.0-2) ... 2020-10-05T11:53:18.323 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-matplotlib. 2020-10-05T11:53:18.336 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../100-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-10-05T11:53:18.382 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-10-05T11:53:18.534 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-funcsigs. 2020-10-05T11:53:18.548 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../089-python-funcsigs_1.0.2-4_all.deb ... 2020-10-05T11:53:18.592 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-10-05T11:53:18.878 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-pluggy. 2020-10-05T11:53:18.891 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../090-python-pluggy_0.6.0-1_all.deb ... 2020-10-05T11:53:18.928 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-10-05T11:53:19.042 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-olefile. 2020-10-05T11:53:19.056 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../101-python3-olefile_0.45.1-1_all.deb ... 2020-10-05T11:53:19.100 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-10-05T11:53:19.215 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-py. 2020-10-05T11:53:19.227 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../091-python-py_1.5.2-1_all.deb ... 2020-10-05T11:53:19.264 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-py (1.5.2-1) ... 2020-10-05T11:53:19.412 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pastescript. 2020-10-05T11:53:19.424 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-2_all.deb ... 2020-10-05T11:53:19.453 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-10-05T11:53:19.584 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-pytest. 2020-10-05T11:53:19.596 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../092-python-pytest_3.3.2-2_all.deb ... 2020-10-05T11:53:19.634 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-10-05T11:53:19.814 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pil:amd64. 2020-10-05T11:53:19.826 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../103-python3-pil_5.1.0-1ubuntu0.3_amd64.deb ... 2020-10-05T11:53:19.863 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-10-05T11:53:19.987 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-attr. 2020-10-05T11:53:19.999 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../093-python3-attr_17.4.0-2_all.deb ... 2020-10-05T11:53:20.037 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-10-05T11:53:20.258 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pluggy. 2020-10-05T11:53:20.273 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../104-python3-pluggy_0.6.0-1_all.deb ... 2020-10-05T11:53:20.317 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-10-05T11:53:20.340 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cycler. 2020-10-05T11:53:20.352 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../094-python3-cycler_0.10.0-1_all.deb ... 2020-10-05T11:53:20.390 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-10-05T11:53:20.620 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-py. 2020-10-05T11:53:20.631 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../105-python3-py_1.5.2-1_all.deb ... 2020-10-05T11:53:20.668 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webencodings. 2020-10-05T11:53:20.669 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-py (1.5.2-1) ... 2020-10-05T11:53:20.680 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../095-python3-webencodings_0.5-2_all.deb ... 2020-10-05T11:53:20.710 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-10-05T11:53:20.973 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyinotify. 2020-10-05T11:53:20.987 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../106-python3-pyinotify_0.9.6-1_all.deb ... 2020-10-05T11:53:21.023 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-10-05T11:53:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-html5lib. 2020-10-05T11:53:21.208 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../096-python3-html5lib_0.999999999-1_all.deb ... 2020-10-05T11:53:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-10-05T11:53:21.326 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pytest. 2020-10-05T11:53:21.338 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../107-python3-pytest_3.3.2-2_all.deb ... 2020-10-05T11:53:21.376 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-10-05T11:53:21.608 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-10-05T11:53:21.620 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../097-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-10-05T11:53:21.657 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-10-05T11:53:21.705 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-simplejson. 2020-10-05T11:53:21.716 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../108-python3-simplejson_3.13.2-1_amd64.deb ... 2020-10-05T11:53:21.755 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-10-05T11:53:22.066 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-tk:amd64. 2020-10-05T11:53:22.077 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyparsing. 2020-10-05T11:53:22.078 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../109-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-10-05T11:53:22.090 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../098-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-10-05T11:53:22.116 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-10-05T11:53:22.128 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-10-05T11:53:22.449 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tz. 2020-10-05T11:53:22.462 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../099-python3-tz_2018.3-2_all.deb ... 2020-10-05T11:53:22.499 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tz (2018.3-2) ... 2020-10-05T11:53:22.578 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package radosgw. 2020-10-05T11:53:22.592 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../110-radosgw_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:53:22.636 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking radosgw (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:22.803 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-matplotlib. 2020-10-05T11:53:22.814 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../100-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-10-05T11:53:22.852 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-10-05T11:53:23.529 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-olefile. 2020-10-05T11:53:23.542 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../101-python3-olefile_0.45.1-1_all.deb ... 2020-10-05T11:53:23.579 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-10-05T11:53:23.598 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package rbd-fuse. 2020-10-05T11:53:23.611 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../111-rbd-fuse_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:53:23.648 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking rbd-fuse (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:23.890 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastescript. 2020-10-05T11:53:23.904 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-2_all.deb ... 2020-10-05T11:53:23.947 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-10-05T11:53:23.948 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-10-05T11:53:24.287 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-10-05T11:53:24.332 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pil:amd64. 2020-10-05T11:53:24.344 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../103-python3-pil_5.1.0-1ubuntu0.3_amd64.deb ... 2020-10-05T11:53:24.382 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-10-05T11:53:24.655 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-10-05T11:53:24.735 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pluggy. 2020-10-05T11:53:24.747 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../104-python3-pluggy_0.6.0-1_all.deb ... 2020-10-05T11:53:24.764 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-10-05T11:53:24.785 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-10-05T11:53:25.063 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-py. 2020-10-05T11:53:25.076 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../105-python3-py_1.5.2-1_all.deb ... 2020-10-05T11:53:25.121 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-py (1.5.2-1) ... 2020-10-05T11:53:25.376 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-10-05T11:53:25.443 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyinotify. 2020-10-05T11:53:25.454 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../106-python3-pyinotify_0.9.6-1_all.deb ... 2020-10-05T11:53:25.493 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-10-05T11:53:25.760 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-10-05T11:53:25.779 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pytest. 2020-10-05T11:53:25.790 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../107-python3-pytest_3.3.2-2_all.deb ... 2020-10-05T11:53:25.829 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-10-05T11:53:26.045 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-webencodings (0.5-2) ... 2020-10-05T11:53:26.174 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplejson. 2020-10-05T11:53:26.187 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../108-python3-simplejson_3.13.2-1_amd64.deb ... 2020-10-05T11:53:26.224 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-10-05T11:53:26.338 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-attr (17.4.0-2) ... 2020-10-05T11:53:26.552 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tk:amd64. 2020-10-05T11:53:26.556 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-10-05T11:53:26.564 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../109-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-10-05T11:53:26.602 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-10-05T11:53:26.674 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-py (1.5.2-1) ... 2020-10-05T11:53:26.997 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package radosgw. 2020-10-05T11:53:27.009 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-10-05T11:53:27.010 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../110-radosgw_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:53:27.038 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking radosgw (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:27.448 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-10-05T11:53:27.791 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-10-05T11:53:28.000 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package rbd-fuse. 2020-10-05T11:53:28.013 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../111-rbd-fuse_16.0.0-6145-gb726425d-1bionic_amd64.deb ... 2020-10-05T11:53:28.059 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking rbd-fuse (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:28.113 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-ceph-argparse (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:28.359 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-10-05T11:53:28.398 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-10-05T11:53:28.672 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-10-05T11:53:28.691 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-10-05T11:53:28.817 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-10-05T11:53:29.015 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-10-05T11:53:29.141 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-10-05T11:53:29.728 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-10-05T11:53:29.760 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-10-05T11:53:30.038 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-10-05T11:53:30.145 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-10-05T11:53:30.339 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-py (1.5.2-1) ... 2020-10-05T11:53:30.421 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webencodings (0.5-2) ... 2020-10-05T11:53:30.549 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-10-05T11:53:30.706 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-attr (17.4.0-2) ... 2020-10-05T11:53:30.893 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-json-pointer (1.10-1) ... 2020-10-05T11:53:30.899 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-10-05T11:53:30.983 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2020-10-05T11:53:31.025 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-py (1.5.2-1) ... 2020-10-05T11:53:31.212 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-10-05T11:53:31.346 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-10-05T11:53:31.368 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-10-05T11:53:31.539 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-10-05T11:53:31.808 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-10-05T11:53:31.840 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-10-05T11:53:32.121 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-10-05T11:53:32.141 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-10-05T11:53:32.414 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-argparse (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:32.425 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-10-05T11:53:32.698 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-10-05T11:53:32.802 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-10-05T11:53:32.992 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-10-05T11:53:33.118 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-10-05T11:53:33.154 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-10-05T11:53:33.413 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up cephadm (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:34.030 INFO:teuthology.orchestra.run.smithi158.stdout:Adding system user cephadm....done 2020-10-05T11:53:34.054 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-10-05T11:53:34.220 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-10-05T11:53:34.363 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-10-05T11:53:34.521 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-10-05T11:53:34.622 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up nvme-cli (1.5-1ubuntu1) ... 2020-10-05T11:53:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-py (1.5.2-1) ... 2020-10-05T11:53:34.723 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-10-05T11:53:34.840 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-10-05T11:53:35.050 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-10-05T11:53:35.193 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-json-pointer (1.10-1) ... 2020-10-05T11:53:35.308 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2020-10-05T11:53:35.326 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-10-05T11:53:35.468 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-10-05T11:53:35.545 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-10-05T11:53:35.671 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-10-05T11:53:35.795 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-ceph-common (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:35.872 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-10-05T11:53:36.097 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-monotonic (1.1-2) ... 2020-10-05T11:53:36.173 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-10-05T11:53:36.498 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-10-05T11:53:36.516 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-10-05T11:53:36.599 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-10-05T11:53:36.808 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-10-05T11:53:36.958 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-10-05T11:53:37.168 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-10-05T11:53:37.310 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-10-05T11:53:37.399 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-10-05T11:53:37.440 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2020-10-05T11:53:37.511 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-10-05T11:53:37.653 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-10-05T11:53:37.804 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephadm (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:37.955 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-10-05T11:53:38.239 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-10-05T11:53:38.472 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user cephadm....done 2020-10-05T11:53:38.557 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-attr (17.4.0-2) ... 2020-10-05T11:53:38.636 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-10-05T11:53:38.850 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-10-05T11:53:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-10-05T11:53:39.043 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-10-05T11:53:39.096 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up nvme-cli (1.5-1ubuntu1) ... 2020-10-05T11:53:39.222 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-10-05T11:53:39.453 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-10-05T11:53:39.543 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-10-05T11:53:39.557 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-10-05T11:53:39.788 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liboath0 (2.6.1-1) ... 2020-10-05T11:53:39.858 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-10-05T11:53:39.948 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-10-05T11:53:39.993 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-10-05T11:53:40.049 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-10-05T11:53:40.267 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-10-05T11:53:40.328 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-common (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:40.393 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-10-05T11:53:40.637 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-monotonic (1.1-2) ... 2020-10-05T11:53:40.803 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-10-05T11:53:40.922 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-10-05T11:53:40.931 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-10-05T11:53:41.047 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-10-05T11:53:41.214 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-tz (2018.3-2) ... 2020-10-05T11:53:41.390 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-10-05T11:53:41.481 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-10-05T11:53:41.734 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-10-05T11:53:41.758 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-10-05T11:53:41.824 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-10-05T11:53:41.864 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2020-10-05T11:53:42.042 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-joblib (0.11-1) ... 2020-10-05T11:53:42.102 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-10-05T11:53:42.403 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-10-05T11:53:42.419 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-routes (2.4.1-1) ... 2020-10-05T11:53:42.688 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-10-05T11:53:42.736 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-10-05T11:53:43.022 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-attr (17.4.0-2) ... 2020-10-05T11:53:43.046 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-10-05T11:53:43.316 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-10-05T11:53:43.356 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-10-05T11:53:43.508 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-10-05T11:53:43.699 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-10-05T11:53:43.927 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-10-05T11:53:44.001 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up jq (1.5+dfsg-2) ... 2020-10-05T11:53:44.016 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-10-05T11:53:44.126 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-10-05T11:53:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liboath0 (2.6.1-1) ... 2020-10-05T11:53:44.454 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-10-05T11:53:44.580 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-10-05T11:53:44.815 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-10-05T11:53:44.924 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-10-05T11:53:45.290 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-10-05T11:53:45.318 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-10-05T11:53:45.444 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-10-05T11:53:45.583 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-10-05T11:53:45.737 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tz (2018.3-2) ... 2020-10-05T11:53:45.893 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-10-05T11:53:46.020 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-10-05T11:53:46.029 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-10-05T11:53:46.314 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-10-05T11:53:46.602 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pytest (3.3.2-2) ... 2020-10-05T11:53:46.607 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-joblib (0.11-1) ... 2020-10-05T11:53:46.950 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-routes (2.4.1-1) ... 2020-10-05T11:53:47.006 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-10-05T11:53:47.107 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-10-05T11:53:47.208 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librados2 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:47.251 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-10-05T11:53:47.318 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-10-05T11:53:47.536 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-10-05T11:53:47.636 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libcephfs2 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:47.764 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libcephfs-dev (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:47.845 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-10-05T11:53:47.865 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rados (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:47.966 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-10-05T11:53:48.205 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-10-05T11:53:48.275 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-10-05T11:53:48.490 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up jq (1.5+dfsg-2) ... 2020-10-05T11:53:48.560 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-10-05T11:53:48.591 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-10-05T11:53:48.903 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-10-05T11:53:49.722 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-10-05T11:53:49.808 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-10-05T11:53:50.040 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-10-05T11:53:50.341 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-10-05T11:53:50.467 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-10-05T11:53:50.637 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-10-05T11:53:50.828 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-pytest (3.3.2-2) ... 2020-10-05T11:53:50.906 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libradosstriper1 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:51.012 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cephfs (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:51.079 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-10-05T11:53:51.221 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-10-05T11:53:51.266 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librgw2 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:51.347 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librados2 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:51.367 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-fuse (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:51.473 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-10-05T11:53:51.582 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-10-05T11:53:51.582 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-10-05T11:53:51.869 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librbd1 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:51.916 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs2 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:51.995 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-10-05T11:53:52.042 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs-dev (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:52.085 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-10-05T11:53:52.117 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-10-05T11:53:52.168 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rados (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:52.294 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-10-05T11:53:52.440 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-10-05T11:53:52.596 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-10-05T11:53:52.897 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-10-05T11:53:53.126 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-modules-core (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:53.223 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-10-05T11:53:53.252 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-10-05T11:53:53.570 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rgw (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:53.696 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up rbd-fuse (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:53.814 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rbd (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:53.915 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-common (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:54.144 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-10-05T11:53:54.408 INFO:teuthology.orchestra.run.smithi158.stdout:Adding group ceph....done 2020-10-05T11:53:54.777 INFO:teuthology.orchestra.run.smithi158.stdout:Adding system user ceph....done 2020-10-05T11:53:54.928 INFO:teuthology.orchestra.run.smithi158.stdout:Setting system user ceph properties....done 2020-10-05T11:53:54.974 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-10-05T11:53:55.083 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-10-05T11:53:55.250 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libradosstriper1 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:55.300 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-10-05T11:53:55.385 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cephfs (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:55.568 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up radosgw (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:55.677 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librgw2 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:55.803 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-fuse (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:55.837 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-10-05T11:53:55.837 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-10-05T11:53:56.021 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-10-05T11:53:56.021 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-10-05T11:53:56.244 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-test (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:56.330 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librbd1 (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:56.370 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-base (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:56.456 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-10-05T11:53:56.546 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-10-05T11:53:56.578 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-10-05T11:53:56.704 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-10-05T11:53:56.884 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-10-05T11:53:57.156 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:57.363 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-10-05T11:53:57.363 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-10-05T11:53:57.554 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-modules-core (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:57.633 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-diskprediction-local (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:57.679 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-10-05T11:53:57.742 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-osd (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:57.989 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rgw (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:58.115 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up rbd-fuse (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:58.158 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-10-05T11:53:58.159 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-10-05T11:53:58.233 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rbd (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:58.367 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-common (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:58.445 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-cephadm (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:58.587 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-rook (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:58.739 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mds (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:58.894 INFO:teuthology.orchestra.run.smithi081.stdout:Adding group ceph....done 2020-10-05T11:53:58.955 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-10-05T11:53:58.955 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-10-05T11:53:59.242 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mon (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:59.288 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user ceph....done 2020-10-05T11:53:59.456 INFO:teuthology.orchestra.run.smithi081.stdout:Setting system user ceph properties....done 2020-10-05T11:53:59.467 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-10-05T11:53:59.467 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-10-05T11:53:59.612 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-10-05T11:53:59.725 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-k8sevents (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:59.826 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-dashboard (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:53:59.835 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-10-05T11:53:59.952 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:54:00.079 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-10-05T11:54:00.153 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up radosgw (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:54:00.280 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-10-05T11:54:00.407 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-10-05T11:54:00.408 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-10-05T11:54:00.830 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-test (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:54:00.956 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-base (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:54:01.269 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-10-05T11:54:01.566 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:54:01.781 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-10-05T11:54:01.781 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-10-05T11:54:02.068 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-diskprediction-local (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:54:02.202 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-osd (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:54:02.350 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-10-05T11:54:02.390 INFO:teuthology.orchestra.run.smithi158.stdout:ureadahead will be reprofiled on next reboot 2020-10-05T11:54:02.442 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.2) ... 2020-10-05T11:54:02.638 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-10-05T11:54:02.638 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-10-05T11:54:02.872 INFO:teuthology.orchestra.run.smithi158.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-10-05T11:54:02.875 DEBUG:teuthology.parallel:result is None 2020-10-05T11:54:02.938 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-cephadm (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:54:03.081 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-rook (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:54:03.207 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mds (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:54:03.416 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-10-05T11:54:03.416 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-10-05T11:54:03.716 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mon (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:54:03.917 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-10-05T11:54:03.917 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-10-05T11:54:04.210 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-k8sevents (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:54:04.310 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-dashboard (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:54:04.436 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph (16.0.0-6145-gb726425d-1bionic) ... 2020-10-05T11:54:04.563 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-10-05T11:54:04.789 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-10-05T11:54:06.791 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-10-05T11:54:06.831 INFO:teuthology.orchestra.run.smithi081.stdout:ureadahead will be reprofiled on next reboot 2020-10-05T11:54:06.875 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.2) ... 2020-10-05T11:54:07.423 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-10-05T11:54:07.425 DEBUG:teuthology.parallel:result is None 2020-10-05T11:54:07.425 INFO:teuthology.orchestra.run.smithi158:> sudo lsb_release -is 2020-10-05T11:54:07.480 INFO:teuthology.orchestra.run.smithi158.stdout:Ubuntu 2020-10-05T11:54:07.485 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-05T11:54:07.485 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=b726425d5bff271f4fe469ee94a9b80f7cad00ba 2020-10-05T11:54:07.648 INFO:teuthology.orchestra.run.smithi158:> dpkg-query -W -f '${Version}' ceph 2020-10-05T11:54:07.674 INFO:teuthology.orchestra.run.smithi158.stdout:16.0.0-6145-gb726425d-1bionic 2020-10-05T11:54:07.675 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-6145-gb726425d-1bionic 2020-10-05T11:54:07.675 INFO:teuthology.task.install:The correct ceph version 16.0.0-6145-gb726425d-1bionic is installed. 2020-10-05T11:54:07.676 INFO:teuthology.orchestra.run.smithi081:> sudo lsb_release -is 2020-10-05T11:54:07.731 INFO:teuthology.orchestra.run.smithi081.stdout:Ubuntu 2020-10-05T11:54:07.736 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-05T11:54:07.737 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=b726425d5bff271f4fe469ee94a9b80f7cad00ba 2020-10-05T11:54:07.903 INFO:teuthology.orchestra.run.smithi081:> dpkg-query -W -f '${Version}' ceph 2020-10-05T11:54:07.928 INFO:teuthology.orchestra.run.smithi081.stdout:16.0.0-6145-gb726425d-1bionic 2020-10-05T11:54:07.929 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-6145-gb726425d-1bionic 2020-10-05T11:54:07.929 INFO:teuthology.task.install:The correct ceph version 16.0.0-6145-gb726425d-1bionic is installed. 2020-10-05T11:54:07.929 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-10-05T11:54:07.930 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:07.930 INFO:teuthology.orchestra.run.smithi158:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-10-05T11:54:07.935 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-10-05T11:54:07.944 INFO:teuthology.orchestra.run.smithi158.stderr:24+1 records in 2020-10-05T11:54:07.945 INFO:teuthology.orchestra.run.smithi158.stderr:24+1 records out 2020-10-05T11:54:07.945 INFO:teuthology.orchestra.run.smithi158.stderr:12667 bytes (13 kB, 12 KiB) copied, 0.000213614 s, 59.3 MB/s 2020-10-05T11:54:07.946 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:07.946 INFO:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-10-05T11:54:07.974 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-10-05T11:54:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:24+1 records in 2020-10-05T11:54:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:24+1 records out 2020-10-05T11:54:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:12667 bytes (13 kB, 12 KiB) copied, 0.000231494 s, 54.7 MB/s 2020-10-05T11:54:07.980 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-10-05T11:54:07.980 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:07.981 INFO:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/daemon-helper 2020-10-05T11:54:07.992 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-10-05T11:54:08.001 INFO:teuthology.orchestra.run.smithi158.stderr:5+1 records in 2020-10-05T11:54:08.001 INFO:teuthology.orchestra.run.smithi158.stderr:5+1 records out 2020-10-05T11:54:08.002 INFO:teuthology.orchestra.run.smithi158.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 0.000100176 s, 30.5 MB/s 2020-10-05T11:54:08.003 INFO:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-10-05T11:54:08.057 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:08.057 INFO:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2020-10-05T11:54:08.062 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-10-05T11:54:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:5+1 records in 2020-10-05T11:54:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:5+1 records out 2020-10-05T11:54:08.071 INFO:teuthology.orchestra.run.smithi081.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 0.000124554 s, 24.6 MB/s 2020-10-05T11:54:08.072 INFO:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-10-05T11:54:08.128 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-10-05T11:54:08.129 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:08.129 INFO:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/adjust-ulimits 2020-10-05T11:54:08.134 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-10-05T11:54:08.142 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:08.143 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:08.143 INFO:teuthology.orchestra.run.smithi158.stderr:299 bytes copied, 6.8357e-05 s, 4.4 MB/s 2020-10-05T11:54:08.144 INFO:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-10-05T11:54:08.197 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:08.197 INFO:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2020-10-05T11:54:08.202 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-10-05T11:54:08.211 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:08.211 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:08.211 INFO:teuthology.orchestra.run.smithi081.stderr:299 bytes copied, 6.8677e-05 s, 4.4 MB/s 2020-10-05T11:54:08.212 INFO:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-10-05T11:54:08.267 INFO:teuthology.run_tasks:Running task ceph... 2020-10-05T11:54:08.327 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-10-05T11:54:08.328 INFO:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2020-10-05T11:54:08.331 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 777 /var/log/ceph 2020-10-05T11:54:08.345 INFO:tasks.ceph:Disabling ceph logrotate... 2020-10-05T11:54:08.346 INFO:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2020-10-05T11:54:08.392 INFO:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/logrotate.d/ceph 2020-10-05T11:54:08.406 INFO:tasks.ceph:Creating extra log directories... 2020-10-05T11:54:08.407 INFO:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-10-05T11:54:08.448 INFO:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-10-05T11:54:08.474 INFO:tasks.ceph:Creating ceph cluster c1... 2020-10-05T11:54:08.474 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(PG_AVAILABILITY\\)'], 'cpu_profile': set(), 'cluster': 'c1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-10-05T11:54:08.474 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuvalif-2020-10-05_09:58:27-rgw-wip-yuval-static-analysis-distro-basic-smithi/5498204', 'branch': 'wip-yuval-static-analysis', 'description': 'rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '5498204', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuvalif-2020-10-05_09:58:27-rgw-wip-yuval-static-analysis-distro-basic-smithi', 'nuke-on-error': True, 'os_type': 'ubuntu', 'overrides': {'admin_socket': {'branch': 'wip-yuval-static-analysis'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c1.client.1'], 'name': 'test-zone3'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone4'}]}]}, 'workunit': {'branch': 'wip-yuval-static-analysis', 'sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba'}}, 'owner': 'scheduled_yuvalif@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-yuval-static-analysis', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-static-analysis/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2'}}, {'rgw': {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'tube': 'smithi', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.24691', 'targets': {'smithi158.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDM+8gyKqtLyk2huQLscFyLhmJAZIlrCwlzCS6kd634CdB5K14NA8AL38jqIQN8zibklKO3OayBU+YotcLsmPxMF6iRMZygMQM71LAdmH0MxiXKjN4fbaEC01ca+ILhynWAnnQtm4u41IPTifYjFcodkHFR0vU88g6j6RlWb2n0Vur+QVvfkjQ43KHToaA+eQ0BhAjzLuQ4W5UJz59MZS84tvuk9ap4r6rzloRHcXisFcRaXn5k9AsEHMsWKUICxdtO3ksVXn5dBmGNQqSx91tZ18+zbthU7MBDwTArb1465TLCD+br4yKIaLnlhRIiwPRrC9fHFzzXk6qaQlnpkZfN', 'smithi081.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSw/9O7CI4W2dWnjnOZxzsRsbd5XrpT8KDTWzX4fLmtu1iO0qqFnAZQiDLhrm7L0sKL1nhRx45Oz1JSRoBKv+31Ncpb3KzmaugaS4V2fQvgMaB3cy86EbX0CMYsyKVoHq600SgP0GRWoR8EUL+P4zycaGiLm5hPzH6swIFXNjqb5WmybLHwrw5vv3308PmVbOISaaA0ZknAt5LruOpH28au5Aa5Q8f6SWOOvv4IEVXv4ASV890FLAn6alJuGkx9kCIqqMqwVt65LcFuNnvFcvXpkHYygIOUlP3wuTdBZS8WLWEkBvrG2A4GufkHdGbcT54T9tv3d2EJl0cEy0qnraP'}} 2020-10-05T11:54:08.475 INFO:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2020-10-05T11:54:08.504 INFO:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2020-10-05T11:54:08.509 INFO:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2020-10-05T11:54:08.552 INFO:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/run/ceph 2020-10-05T11:54:08.567 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:08.567 INFO:teuthology.orchestra.run.smithi158:> dd if=/scratch_devs of=/dev/stdout 2020-10-05T11:54:08.613 INFO:teuthology.orchestra.run.smithi158.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-10-05T11:54:08.614 INFO:teuthology.orchestra.run.smithi158.stdout:/dev/vg_nvme/lv_1 2020-10-05T11:54:08.614 INFO:teuthology.orchestra.run.smithi158.stdout:/dev/vg_nvme/lv_2 2020-10-05T11:54:08.614 INFO:teuthology.orchestra.run.smithi158.stdout:/dev/vg_nvme/lv_3 2020-10-05T11:54:08.614 INFO:teuthology.orchestra.run.smithi158.stdout:/dev/vg_nvme/lv_4 2020-10-05T11:54:08.615 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:08.615 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:08.615 INFO:teuthology.orchestra.run.smithi158.stderr:72 bytes copied, 0.000156655 s, 460 kB/s 2020-10-05T11:54:08.615 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-10-05T11:54:08.615 INFO:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-10-05T11:54:08.663 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-10-05T11:54:08.663 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-05T11:54:08.663 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 342 Links: 1 2020-10-05T11:54:08.664 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-05T11:54:08.664 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2020-10-05 11:51:49.039817195 +0000 2020-10-05T11:54:08.664 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2020-10-05 11:51:48.935817194 +0000 2020-10-05T11:54:08.664 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2020-10-05 11:51:48.935817194 +0000 2020-10-05T11:54:08.664 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2020-10-05T11:54:08.673 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2020-10-05T11:54:08.673 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2020-10-05T11:54:08.673 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000391681 s, 1.3 MB/s 2020-10-05T11:54:08.677 INFO:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-10-05T11:54:08.727 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-10-05T11:54:08.727 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-05T11:54:08.727 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 348 Links: 1 2020-10-05T11:54:08.727 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-05T11:54:08.727 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2020-10-05 11:51:49.187817197 +0000 2020-10-05T11:54:08.728 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2020-10-05 11:51:49.183817197 +0000 2020-10-05T11:54:08.728 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2020-10-05 11:51:49.183817197 +0000 2020-10-05T11:54:08.728 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2020-10-05T11:54:08.736 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2020-10-05T11:54:08.736 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2020-10-05T11:54:08.736 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000338677 s, 1.5 MB/s 2020-10-05T11:54:08.740 INFO:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-10-05T11:54:08.787 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-10-05T11:54:08.787 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-05T11:54:08.787 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 354 Links: 1 2020-10-05T11:54:08.787 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-05T11:54:08.787 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2020-10-05 11:51:49.527817200 +0000 2020-10-05T11:54:08.788 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2020-10-05 11:51:49.427817199 +0000 2020-10-05T11:54:08.788 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2020-10-05 11:51:49.427817199 +0000 2020-10-05T11:54:08.788 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2020-10-05T11:54:08.796 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2020-10-05T11:54:08.796 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2020-10-05T11:54:08.796 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000371855 s, 1.4 MB/s 2020-10-05T11:54:08.801 INFO:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-10-05T11:54:08.855 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-10-05T11:54:08.855 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-05T11:54:08.855 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 361 Links: 1 2020-10-05T11:54:08.855 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-05T11:54:08.855 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2020-10-05 11:51:49.763817202 +0000 2020-10-05T11:54:08.856 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2020-10-05 11:51:49.651817201 +0000 2020-10-05T11:54:08.856 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2020-10-05 11:51:49.651817201 +0000 2020-10-05T11:54:08.856 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2020-10-05T11:54:08.864 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2020-10-05T11:54:08.864 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2020-10-05T11:54:08.864 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000393995 s, 1.3 MB/s 2020-10-05T11:54:08.868 INFO:tasks.ceph:osd dev map: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2020-10-05T11:54:08.868 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi158.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2020-10-05T11:54:08.868 INFO:tasks.ceph:Generating config... 2020-10-05T11:54:08.870 INFO:tasks.ceph:[client] debug rgw = 20 2020-10-05T11:54:08.870 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2020-10-05T11:54:08.870 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2020-10-05T11:54:08.870 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2020-10-05T11:54:08.871 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2020-10-05T11:54:08.871 INFO:tasks.ceph:[client] rgw data log num shards = 4 2020-10-05T11:54:08.871 INFO:tasks.ceph:[client] rgw md log max shards = 4 2020-10-05T11:54:08.871 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2020-10-05T11:54:08.871 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2020-10-05T11:54:08.872 INFO:tasks.ceph:[client] setgroup = ceph 2020-10-05T11:54:08.872 INFO:tasks.ceph:[client] setuser = ceph 2020-10-05T11:54:08.872 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2020-10-05T11:54:08.872 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-10-05T11:54:08.872 INFO:tasks.ceph:[mgr] debug ms = 1 2020-10-05T11:54:08.873 INFO:tasks.ceph:[mon] debug mon = 20 2020-10-05T11:54:08.873 INFO:tasks.ceph:[mon] debug ms = 1 2020-10-05T11:54:08.873 INFO:tasks.ceph:[mon] debug paxos = 20 2020-10-05T11:54:08.873 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2020-10-05T11:54:08.873 INFO:tasks.ceph:[osd] debug filestore = 20 2020-10-05T11:54:08.874 INFO:tasks.ceph:[osd] debug journal = 20 2020-10-05T11:54:08.874 INFO:tasks.ceph:[osd] debug ms = 20 2020-10-05T11:54:08.874 INFO:tasks.ceph:[osd] debug osd = 25 2020-10-05T11:54:08.874 INFO:tasks.ceph:[osd] osd fast shutdown = False 2020-10-05T11:54:08.874 INFO:tasks.ceph:[osd] rocksdb delete range threshold = 0 2020-10-05T11:54:08.875 INFO:tasks.ceph:[osd.0] osd_max_omap_entries_per_request = 10 2020-10-05T11:54:08.875 INFO:tasks.ceph:[osd.1] osd_max_omap_entries_per_request = 1000 2020-10-05T11:54:08.875 INFO:tasks.ceph:[osd.2] osd_max_omap_entries_per_request = 10000 2020-10-05T11:54:08.875 INFO:tasks.ceph:Setting up c1.mon.a... 2020-10-05T11:54:08.876 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c1.keyring 2020-10-05T11:54:08.939 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/c1.keyring 2020-10-05T11:54:08.942 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c1.keyring 2020-10-05T11:54:09.018 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0644 /etc/ceph/c1.keyring 2020-10-05T11:54:09.074 DEBUG:tasks.ceph:Ceph mon addresses: [('c1.mon.a', '172.21.15.158')] 2020-10-05T11:54:09.075 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon host': '172.21.15.158', 'osd heartbeat grace': 40}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False, 'rocksdb delete range threshold': 0}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}} 2020-10-05T11:54:09.076 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:09.076 INFO:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-10-05T11:54:09.120 INFO:teuthology.orchestra.run.smithi158.stderr:+ dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-10-05T11:54:09.122 INFO:teuthology.orchestra.run.smithi158.stderr:6+1 records in 2020-10-05T11:54:09.122 INFO:teuthology.orchestra.run.smithi158.stderr:6+1 records out 2020-10-05T11:54:09.122 INFO:teuthology.orchestra.run.smithi158.stderr:3101 bytes (3.1 kB, 3.0 KiB) copied, 0.000104844 s, 29.6 MB/s 2020-10-05T11:54:09.123 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.158 --print /home/ubuntu/cephtest/c1.monmap 2020-10-05T11:54:09.194 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:54:09.195 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:54:09.195 INFO:teuthology.orchestra.run.smithi158.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c1.monmap 2020-10-05T11:54:09.195 INFO:teuthology.orchestra.run.smithi158.stdout:monmaptool: generated fsid 4331870b-f076-4188-a25a-790b1da8adc7 2020-10-05T11:54:09.195 INFO:teuthology.orchestra.run.smithi158.stdout:epoch 0 2020-10-05T11:54:09.195 INFO:teuthology.orchestra.run.smithi158.stdout:fsid 4331870b-f076-4188-a25a-790b1da8adc7 2020-10-05T11:54:09.196 INFO:teuthology.orchestra.run.smithi158.stdout:last_changed 2020-10-05T11:54:09.194712+0000 2020-10-05T11:54:09.196 INFO:teuthology.orchestra.run.smithi158.stdout:created 2020-10-05T11:54:09.194712+0000 2020-10-05T11:54:09.196 INFO:teuthology.orchestra.run.smithi158.stdout:min_mon_release 0 (unknown) 2020-10-05T11:54:09.196 INFO:teuthology.orchestra.run.smithi158.stdout:election_strategy: 1 2020-10-05T11:54:09.196 INFO:teuthology.orchestra.run.smithi158.stdout:0: [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] mon.a 2020-10-05T11:54:09.196 INFO:teuthology.orchestra.run.smithi158.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c1.monmap (1 monitors) 2020-10-05T11:54:09.198 INFO:teuthology.orchestra.run.smithi158:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2020-10-05T11:54:09.246 INFO:tasks.ceph:Writing /etc/ceph/c1.conf for FSID 4331870b-f076-4188-a25a-790b1da8adc7... 2020-10-05T11:54:09.247 INFO:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2020-10-05T11:54:09.250 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2020-10-05T11:54:09.291 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2020-10-05T11:54:09.291 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2020-10-05T11:54:09.291 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-05T11:54:09.291 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2020-10-05T11:54:09.291 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2020-10-05T11:54:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2020-10-05T11:54:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2020-10-05T11:54:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2020-10-05T11:54:09.293 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.293 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2020-10-05T11:54:09.293 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2020-10-05T11:54:09.293 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.293 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-05T11:54:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2020-10-05T11:54:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2020-10-05T11:54:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-05T11:54:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2020-10-05T11:54:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.295 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2020-10-05T11:54:09.295 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2020-10-05T11:54:09.295 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2020-10-05T11:54:09.295 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2020-10-05T11:54:09.295 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2020-10-05T11:54:09.295 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2020-10-05T11:54:09.295 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2020-10-05T11:54:09.296 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-05T11:54:09.296 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-05T11:54:09.296 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2020-10-05T11:54:09.296 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.296 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-05T11:54:09.296 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.296 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2020-10-05T11:54:09.297 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.297 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2020-10-05T11:54:09.297 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.297 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2020-10-05T11:54:09.297 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2020-10-05T11:54:09.297 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = 172.21.15.158 2020-10-05T11:54:09.297 INFO:teuthology.orchestra.run.smithi081.stdout: osd heartbeat grace = 40 2020-10-05T11:54:09.298 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 4331870b-f076-4188-a25a-790b1da8adc7 2020-10-05T11:54:09.298 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.298 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2020-10-05T11:54:09.298 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2020-10-05T11:54:09.298 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.299 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2020-10-05T11:54:09.299 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2020-10-05T11:54:09.299 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.299 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2020-10-05T11:54:09.299 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2020-10-05T11:54:09.299 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.299 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2020-10-05T11:54:09.299 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2020-10-05T11:54:09.300 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2020-10-05T11:54:09.300 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.300 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2020-10-05T11:54:09.300 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2020-10-05T11:54:09.300 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.300 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2020-10-05T11:54:09.300 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.301 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2020-10-05T11:54:09.301 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.301 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2020-10-05T11:54:09.301 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.301 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2020-10-05T11:54:09.301 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2020-10-05T11:54:09.301 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.302 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2020-10-05T11:54:09.302 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2020-10-05T11:54:09.302 INFO:teuthology.orchestra.run.smithi081.stdout: debug filestore = 20 2020-10-05T11:54:09.302 INFO:teuthology.orchestra.run.smithi081.stdout: debug journal = 20 2020-10-05T11:54:09.302 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 20 2020-10-05T11:54:09.302 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 25 2020-10-05T11:54:09.302 INFO:teuthology.orchestra.run.smithi081.stdout: osd fast shutdown = False 2020-10-05T11:54:09.303 INFO:teuthology.orchestra.run.smithi081.stdout: rocksdb delete range threshold = 0 2020-10-05T11:54:09.303 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.303 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2020-10-05T11:54:09.303 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2020-10-05T11:54:09.303 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2020-10-05T11:54:09.303 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2020-10-05T11:54:09.303 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2020-10-05T11:54:09.304 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2020-10-05T11:54:09.304 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2020-10-05T11:54:09.304 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2020-10-05T11:54:09.304 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.304 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2020-10-05T11:54:09.304 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2020-10-05T11:54:09.304 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2020-10-05T11:54:09.305 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2020-10-05T11:54:09.305 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2020-10-05T11:54:09.305 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2020-10-05T11:54:09.305 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2020-10-05T11:54:09.305 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2020-10-05T11:54:09.305 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2020-10-05T11:54:09.305 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2020-10-05T11:54:09.306 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2020-10-05T11:54:09.306 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd crush smoke test = False 2020-10-05T11:54:09.306 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:09.306 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2020-10-05T11:54:09.306 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2020-10-05T11:54:09.306 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2020-10-05T11:54:09.306 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2020-10-05T11:54:09.307 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-05T11:54:09.307 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-05T11:54:09.307 INFO:teuthology.orchestra.run.smithi081.stdout: debug rgw = 20 2020-10-05T11:54:09.307 INFO:teuthology.orchestra.run.smithi081.stdout: rgw crypt require ssl = False 2020-10-05T11:54:09.307 INFO:teuthology.orchestra.run.smithi081.stdout: rgw crypt s3 kms backend = testing 2020-10-05T11:54:09.307 INFO:teuthology.orchestra.run.smithi081.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2020-10-05T11:54:09.307 INFO:teuthology.orchestra.run.smithi081.stdout: rgw curl low speed time = 300 2020-10-05T11:54:09.307 INFO:teuthology.orchestra.run.smithi081.stdout: rgw data log num shards = 4 2020-10-05T11:54:09.308 INFO:teuthology.orchestra.run.smithi081.stdout: rgw md log max shards = 4 2020-10-05T11:54:09.308 INFO:teuthology.orchestra.run.smithi081.stdout: rgw sync log trim interval = 0 2020-10-05T11:54:09.308 INFO:teuthology.orchestra.run.smithi081.stdout: rgw sync obj etag verify = True 2020-10-05T11:54:09.308 INFO:teuthology.orchestra.run.smithi081.stdout: setgroup = ceph 2020-10-05T11:54:09.308 INFO:teuthology.orchestra.run.smithi081.stdout: setuser = ceph 2020-10-05T11:54:09.308 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2020-10-05T11:54:09.308 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2020-10-05T11:54:09.309 INFO:teuthology.orchestra.run.smithi081.stdout: osd_max_omap_entries_per_request = 10 2020-10-05T11:54:09.309 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2020-10-05T11:54:09.309 INFO:teuthology.orchestra.run.smithi081.stdout: osd_max_omap_entries_per_request = 1000 2020-10-05T11:54:09.309 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2020-10-05T11:54:09.309 INFO:teuthology.orchestra.run.smithi081.stdout: osd_max_omap_entries_per_request = 10000 2020-10-05T11:54:09.321 INFO:teuthology.orchestra.run.smithi158.stdout:[global] 2020-10-05T11:54:09.322 INFO:teuthology.orchestra.run.smithi158.stdout: chdir = "" 2020-10-05T11:54:09.322 INFO:teuthology.orchestra.run.smithi158.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-05T11:54:09.322 INFO:teuthology.orchestra.run.smithi158.stdout: auth supported = cephx 2020-10-05T11:54:09.322 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.322 INFO:teuthology.orchestra.run.smithi158.stdout: filestore xattr use omap = true 2020-10-05T11:54:09.323 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.323 INFO:teuthology.orchestra.run.smithi158.stdout: mon clock drift allowed = 1.000 2020-10-05T11:54:09.323 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.323 INFO:teuthology.orchestra.run.smithi158.stdout: osd crush chooseleaf type = 0 2020-10-05T11:54:09.323 INFO:teuthology.orchestra.run.smithi158.stdout: auth debug = true 2020-10-05T11:54:09.323 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.323 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on old message = true 2020-10-05T11:54:09.323 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on bug = true 2020-10-05T11:54:09.324 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.324 INFO:teuthology.orchestra.run.smithi158.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-05T11:54:09.324 INFO:teuthology.orchestra.run.smithi158.stdout: mon pg warn max object skew = 0 2020-10-05T11:54:09.324 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.324 INFO:teuthology.orchestra.run.smithi158.stdout: # disable pg_autoscaler by default for new pools 2020-10-05T11:54:09.324 INFO:teuthology.orchestra.run.smithi158.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-05T11:54:09.324 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.325 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default size = 2 2020-10-05T11:54:09.325 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.325 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow primary affinity = true 2020-10-05T11:54:09.325 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow pg remap = true 2020-10-05T11:54:09.325 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on legacy crush tunables = false 2020-10-05T11:54:09.325 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on crush straw calc version zero = false 2020-10-05T11:54:09.325 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on no sortbitwise = false 2020-10-05T11:54:09.326 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on osd down out interval zero = false 2020-10-05T11:54:09.326 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on too few osds = false 2020-10-05T11:54:09.326 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-05T11:54:09.326 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-05T11:54:09.326 INFO:teuthology.orchestra.run.smithi158.stdout: mon_allow_pool_size_one = true 2020-10-05T11:54:09.326 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.327 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-05T11:54:09.327 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.327 INFO:teuthology.orchestra.run.smithi158.stdout: osd default data pool replay window = 5 2020-10-05T11:54:09.327 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.327 INFO:teuthology.orchestra.run.smithi158.stdout: mon allow pool delete = true 2020-10-05T11:54:09.327 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.327 INFO:teuthology.orchestra.run.smithi158.stdout: mon cluster log file level = debug 2020-10-05T11:54:09.327 INFO:teuthology.orchestra.run.smithi158.stdout: debug asserts on shutdown = true 2020-10-05T11:54:09.328 INFO:teuthology.orchestra.run.smithi158.stdout: mon host = 172.21.15.158 2020-10-05T11:54:09.328 INFO:teuthology.orchestra.run.smithi158.stdout: osd heartbeat grace = 40 2020-10-05T11:54:09.328 INFO:teuthology.orchestra.run.smithi158.stdout: fsid = 4331870b-f076-4188-a25a-790b1da8adc7 2020-10-05T11:54:09.328 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.328 INFO:teuthology.orchestra.run.smithi158.stdout:[osd] 2020-10-05T11:54:09.328 INFO:teuthology.orchestra.run.smithi158.stdout: osd journal size = 100 2020-10-05T11:54:09.328 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.329 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub load threshold = 5.0 2020-10-05T11:54:09.329 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub max interval = 600 2020-10-05T11:54:09.329 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.329 INFO:teuthology.orchestra.run.smithi158.stdout: osd recover clone overlap = true 2020-10-05T11:54:09.329 INFO:teuthology.orchestra.run.smithi158.stdout: osd recovery max chunk = 1048576 2020-10-05T11:54:09.329 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.329 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug shutdown = true 2020-10-05T11:54:09.329 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug op order = true 2020-10-05T11:54:09.330 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug verify stray on activate = true 2020-10-05T11:54:09.330 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.330 INFO:teuthology.orchestra.run.smithi158.stdout: osd open classes on start = true 2020-10-05T11:54:09.330 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug pg log writeout = true 2020-10-05T11:54:09.330 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.330 INFO:teuthology.orchestra.run.smithi158.stdout: osd deep scrub update digest min age = 30 2020-10-05T11:54:09.330 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.331 INFO:teuthology.orchestra.run.smithi158.stdout: osd map max advance = 10 2020-10-05T11:54:09.331 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.331 INFO:teuthology.orchestra.run.smithi158.stdout: journal zero on create = true 2020-10-05T11:54:09.331 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.331 INFO:teuthology.orchestra.run.smithi158.stdout: filestore ondisk finisher threads = 3 2020-10-05T11:54:09.331 INFO:teuthology.orchestra.run.smithi158.stdout: filestore apply finisher threads = 3 2020-10-05T11:54:09.331 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.332 INFO:teuthology.orchestra.run.smithi158.stdout: bdev debug aio = true 2020-10-05T11:54:09.332 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug misdirected ops = true 2020-10-05T11:54:09.332 INFO:teuthology.orchestra.run.smithi158.stdout: debug filestore = 20 2020-10-05T11:54:09.332 INFO:teuthology.orchestra.run.smithi158.stdout: debug journal = 20 2020-10-05T11:54:09.332 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 20 2020-10-05T11:54:09.332 INFO:teuthology.orchestra.run.smithi158.stdout: debug osd = 25 2020-10-05T11:54:09.332 INFO:teuthology.orchestra.run.smithi158.stdout: osd fast shutdown = False 2020-10-05T11:54:09.333 INFO:teuthology.orchestra.run.smithi158.stdout: rocksdb delete range threshold = 0 2020-10-05T11:54:09.333 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.333 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr] 2020-10-05T11:54:09.333 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2020-10-05T11:54:09.333 INFO:teuthology.orchestra.run.smithi158.stdout: debug mgr = 20 2020-10-05T11:54:09.333 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2020-10-05T11:54:09.333 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2020-10-05T11:54:09.333 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2020-10-05T11:54:09.334 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2020-10-05T11:54:09.334 INFO:teuthology.orchestra.run.smithi158.stdout: mgr/telemetry/nag = false 2020-10-05T11:54:09.334 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.334 INFO:teuthology.orchestra.run.smithi158.stdout:[mon] 2020-10-05T11:54:09.334 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2020-10-05T11:54:09.334 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2020-10-05T11:54:09.334 INFO:teuthology.orchestra.run.smithi158.stdout: debug paxos = 20 2020-10-05T11:54:09.335 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2020-10-05T11:54:09.335 INFO:teuthology.orchestra.run.smithi158.stdout: mon data avail warn = 5 2020-10-05T11:54:09.335 INFO:teuthology.orchestra.run.smithi158.stdout: mon mgr mkfs grace = 240 2020-10-05T11:54:09.335 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2020-10-05T11:54:09.335 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd reporter subtree level = osd 2020-10-05T11:54:09.335 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd prime pg temp = true 2020-10-05T11:54:09.335 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2020-10-05T11:54:09.336 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd crush smoke test = False 2020-10-05T11:54:09.336 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:09.336 INFO:teuthology.orchestra.run.smithi158.stdout:[client] 2020-10-05T11:54:09.336 INFO:teuthology.orchestra.run.smithi158.stdout: rgw cache enabled = true 2020-10-05T11:54:09.336 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable ops log = true 2020-10-05T11:54:09.336 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable usage log = true 2020-10-05T11:54:09.336 INFO:teuthology.orchestra.run.smithi158.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-05T11:54:09.337 INFO:teuthology.orchestra.run.smithi158.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-05T11:54:09.337 INFO:teuthology.orchestra.run.smithi158.stdout: debug rgw = 20 2020-10-05T11:54:09.337 INFO:teuthology.orchestra.run.smithi158.stdout: rgw crypt require ssl = False 2020-10-05T11:54:09.337 INFO:teuthology.orchestra.run.smithi158.stdout: rgw crypt s3 kms backend = testing 2020-10-05T11:54:09.337 INFO:teuthology.orchestra.run.smithi158.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2020-10-05T11:54:09.337 INFO:teuthology.orchestra.run.smithi158.stdout: rgw curl low speed time = 300 2020-10-05T11:54:09.337 INFO:teuthology.orchestra.run.smithi158.stdout: rgw data log num shards = 4 2020-10-05T11:54:09.337 INFO:teuthology.orchestra.run.smithi158.stdout: rgw md log max shards = 4 2020-10-05T11:54:09.338 INFO:teuthology.orchestra.run.smithi158.stdout: rgw sync log trim interval = 0 2020-10-05T11:54:09.338 INFO:teuthology.orchestra.run.smithi158.stdout: rgw sync obj etag verify = True 2020-10-05T11:54:09.338 INFO:teuthology.orchestra.run.smithi158.stdout: setgroup = ceph 2020-10-05T11:54:09.338 INFO:teuthology.orchestra.run.smithi158.stdout: setuser = ceph 2020-10-05T11:54:09.338 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.a] 2020-10-05T11:54:09.338 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.0] 2020-10-05T11:54:09.338 INFO:teuthology.orchestra.run.smithi158.stdout: osd_max_omap_entries_per_request = 10 2020-10-05T11:54:09.339 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.1] 2020-10-05T11:54:09.339 INFO:teuthology.orchestra.run.smithi158.stdout: osd_max_omap_entries_per_request = 1000 2020-10-05T11:54:09.339 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.2] 2020-10-05T11:54:09.339 INFO:teuthology.orchestra.run.smithi158.stdout: osd_max_omap_entries_per_request = 10000 2020-10-05T11:54:09.340 INFO:tasks.ceph:Creating admin key on c1.mon.a... 2020-10-05T11:54:09.340 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c1.keyring 2020-10-05T11:54:09.423 INFO:tasks.ceph:Copying monmap to all nodes... 2020-10-05T11:54:09.423 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:09.424 INFO:teuthology.orchestra.run.smithi158:> dd if=/etc/ceph/c1.keyring of=/dev/stdout 2020-10-05T11:54:09.469 INFO:teuthology.orchestra.run.smithi158.stderr:+ dd if=/etc/ceph/c1.keyring of=/dev/stdout 2020-10-05T11:54:09.470 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.] 2020-10-05T11:54:09.471 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBhCXtfsf3tABAAth2NfQGsIeEXBAuB1DODQA== 2020-10-05T11:54:09.471 INFO:teuthology.orchestra.run.smithi158.stdout:[client.admin] 2020-10-05T11:54:09.471 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBhCXtfDqUSGRAAL7pBpGSDdiiSQfLbV/aGTw== 2020-10-05T11:54:09.472 INFO:teuthology.orchestra.run.smithi158.stdout: caps mds = "allow *" 2020-10-05T11:54:09.472 INFO:teuthology.orchestra.run.smithi158.stdout: caps mgr = "allow *" 2020-10-05T11:54:09.472 INFO:teuthology.orchestra.run.smithi158.stdout: caps mon = "allow *" 2020-10-05T11:54:09.472 INFO:teuthology.orchestra.run.smithi158.stdout: caps osd = "allow *" 2020-10-05T11:54:09.473 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:09.473 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:09.473 INFO:teuthology.orchestra.run.smithi158.stderr:206 bytes copied, 0.000168337 s, 1.2 MB/s 2020-10-05T11:54:09.473 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:09.474 INFO:teuthology.orchestra.run.smithi158:> dd if=/home/ubuntu/cephtest/c1.monmap of=/dev/stdout 2020-10-05T11:54:09.517 INFO:teuthology.orchestra.run.smithi158.stderr:+ dd if=/home/ubuntu/cephtest/c1.monmap of=/dev/stdout 2020-10-05T11:54:09.518 INFO:teuthology.orchestra.run.smithi158.stdout: �C1� �vA��Zy ���a {_?� a {_?� �aXa �����a 2020-10-05T11:54:09.519 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:09.519 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:09.519 INFO:teuthology.orchestra.run.smithi158.stderr:201 bytes copied, 0.00016157 s, 1.2 MB/s 2020-10-05T11:54:09.519 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi158.front.sepia.ceph.com 2020-10-05T11:54:09.520 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:09.520 INFO:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/ceph/c1.keyring 2020-10-05T11:54:09.520 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0644 /etc/ceph/c1.keyring 2020-10-05T11:54:09.565 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo dd of=/etc/ceph/c1.keyring 2020-10-05T11:54:09.573 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:09.573 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:09.573 INFO:teuthology.orchestra.run.smithi158.stderr:206 bytes copied, 0.000135173 s, 1.5 MB/s 2020-10-05T11:54:09.574 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo chmod 0644 /etc/ceph/c1.keyring 2020-10-05T11:54:09.584 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:09.584 INFO:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/c1.monmap 2020-10-05T11:54:09.628 INFO:teuthology.orchestra.run.smithi158.stderr:+ dd of=/home/ubuntu/cephtest/c1.monmap 2020-10-05T11:54:09.630 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:09.630 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:09.630 INFO:teuthology.orchestra.run.smithi158.stderr:201 bytes copied, 0.000126774 s, 1.6 MB/s 2020-10-05T11:54:09.631 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2020-10-05T11:54:09.631 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:09.631 INFO:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/c1.keyring 2020-10-05T11:54:09.631 INFO:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/c1.keyring 2020-10-05T11:54:09.636 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo dd of=/etc/ceph/c1.keyring 2020-10-05T11:54:09.645 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:09.645 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:09.646 INFO:teuthology.orchestra.run.smithi081.stderr:206 bytes copied, 7.4646e-05 s, 2.8 MB/s 2020-10-05T11:54:09.646 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo chmod 0644 /etc/ceph/c1.keyring 2020-10-05T11:54:09.656 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:09.656 INFO:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/c1.monmap 2020-10-05T11:54:09.703 INFO:teuthology.orchestra.run.smithi081.stderr:+ dd of=/home/ubuntu/cephtest/c1.monmap 2020-10-05T11:54:09.705 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:09.705 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:09.705 INFO:teuthology.orchestra.run.smithi081.stderr:201 bytes copied, 6.6766e-05 s, 3.0 MB/s 2020-10-05T11:54:09.705 INFO:tasks.ceph:Setting up mon nodes... 2020-10-05T11:54:09.706 INFO:tasks.ceph:Setting up mgr nodes... 2020-10-05T11:54:09.706 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mgr/c1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c1-x/keyring 2020-10-05T11:54:09.746 INFO:teuthology.orchestra.run.smithi158.stdout:creating /var/lib/ceph/mgr/c1-x/keyring 2020-10-05T11:54:09.748 INFO:tasks.ceph:Setting up mds nodes... 2020-10-05T11:54:09.749 INFO:tasks.ceph_client:Setting up client nodes... 2020-10-05T11:54:09.749 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c1.client.0.keyring && sudo chmod 0644 /etc/ceph/c1.client.0.keyring 2020-10-05T11:54:09.820 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/c1.client.0.keyring 2020-10-05T11:54:09.832 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c1.client.1.keyring && sudo chmod 0644 /etc/ceph/c1.client.1.keyring 2020-10-05T11:54:09.909 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/c1.client.1.keyring 2020-10-05T11:54:09.919 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-10-05T11:54:09.920 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi158.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2020-10-05T11:54:09.920 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/c1-0 2020-10-05T11:54:09.975 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2020-10-05T11:54:09.976 INFO:tasks.ceph:role: c1.osd.0 2020-10-05T11:54:09.976 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi158.front.sepia.ceph.com 2020-10-05T11:54:09.976 INFO:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-10-05T11:54:10.507 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-10-05T11:54:10.508 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2020-10-05T11:54:10.508 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-10-05T11:54:10.508 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-10-05T11:54:10.508 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2020-10-05T11:54:10.508 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-10-05T11:54:10.508 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-10-05T11:54:10.508 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-10-05T11:54:10.509 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-10-05T11:54:10.509 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2020-10-05T11:54:10.510 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c1-0 2020-10-05T11:54:10.575 INFO:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-0 2020-10-05T11:54:10.586 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: /sbin/restorecon: command not found 2020-10-05T11:54:10.587 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-05T11:54:10.587 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/c1-1 2020-10-05T11:54:10.641 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2020-10-05T11:54:10.642 INFO:tasks.ceph:role: c1.osd.1 2020-10-05T11:54:10.642 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi158.front.sepia.ceph.com 2020-10-05T11:54:10.642 INFO:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-10-05T11:54:11.176 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-10-05T11:54:11.176 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2020-10-05T11:54:11.176 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-10-05T11:54:11.176 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-10-05T11:54:11.177 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2020-10-05T11:54:11.177 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-10-05T11:54:11.177 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-10-05T11:54:11.177 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-10-05T11:54:11.177 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-10-05T11:54:11.177 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2020-10-05T11:54:11.178 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c1-1 2020-10-05T11:54:11.223 INFO:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-1 2020-10-05T11:54:11.275 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: /sbin/restorecon: command not found 2020-10-05T11:54:11.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-05T11:54:11.277 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/c1-2 2020-10-05T11:54:11.332 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2020-10-05T11:54:11.333 INFO:tasks.ceph:role: c1.osd.2 2020-10-05T11:54:11.333 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi158.front.sepia.ceph.com 2020-10-05T11:54:11.333 INFO:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-10-05T11:54:11.871 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-10-05T11:54:11.872 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2020-10-05T11:54:11.872 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-10-05T11:54:11.872 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-10-05T11:54:11.872 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2020-10-05T11:54:11.873 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-10-05T11:54:11.873 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-10-05T11:54:11.873 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-10-05T11:54:11.873 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-10-05T11:54:11.874 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2020-10-05T11:54:11.874 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c1-2 2020-10-05T11:54:11.927 INFO:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-2 2020-10-05T11:54:11.939 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: /sbin/restorecon: command not found 2020-10-05T11:54:11.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-05T11:54:11.940 INFO:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c1.monmap 2020-10-05T11:54:12.024 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:12.020+0000 7f8e7d4e5d80 -1 auth: error reading file: /var/lib/ceph/osd/c1-0/keyring: can't open /var/lib/ceph/osd/c1-0/keyring: (2) No such file or directory 2020-10-05T11:54:12.025 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:12.020+0000 7f8e7d4e5d80 -1 created new key in keyring /var/lib/ceph/osd/c1-0/keyring 2020-10-05T11:54:12.025 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:12.020+0000 7f8e7d4e5d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2020-10-05T11:54:12.025 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:12.020+0000 7f8e7d4e5d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2020-10-05T11:54:12.026 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:12.020+0000 7f8e7d4e5d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2020-10-05T11:54:12.032 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:12.028+0000 7f8e7d4e5d80 -1 bluestore(/var/lib/ceph/osd/c1-0) _read_fsid unparsable uuid 2020-10-05T11:54:14.232 INFO:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-0 2020-10-05T11:54:14.295 INFO:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c1.monmap 2020-10-05T11:54:14.375 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:14.372+0000 7f43065e9d80 -1 auth: error reading file: /var/lib/ceph/osd/c1-1/keyring: can't open /var/lib/ceph/osd/c1-1/keyring: (2) No such file or directory 2020-10-05T11:54:14.375 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:14.372+0000 7f43065e9d80 -1 created new key in keyring /var/lib/ceph/osd/c1-1/keyring 2020-10-05T11:54:14.376 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:14.372+0000 7f43065e9d80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2020-10-05T11:54:14.376 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:14.372+0000 7f43065e9d80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2020-10-05T11:54:14.376 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:14.372+0000 7f43065e9d80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2020-10-05T11:54:14.376 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:14.372+0000 7f43065e9d80 -1 bluestore(/var/lib/ceph/osd/c1-1) _read_fsid unparsable uuid 2020-10-05T11:54:16.548 INFO:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-1 2020-10-05T11:54:16.602 INFO:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c1.monmap 2020-10-05T11:54:16.683 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:16.680+0000 7fe4b397ed80 -1 auth: error reading file: /var/lib/ceph/osd/c1-2/keyring: can't open /var/lib/ceph/osd/c1-2/keyring: (2) No such file or directory 2020-10-05T11:54:16.683 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:16.680+0000 7fe4b397ed80 -1 created new key in keyring /var/lib/ceph/osd/c1-2/keyring 2020-10-05T11:54:16.683 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:16.680+0000 7fe4b397ed80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2020-10-05T11:54:16.683 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:16.680+0000 7fe4b397ed80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2020-10-05T11:54:16.683 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:16.680+0000 7fe4b397ed80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2020-10-05T11:54:16.684 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:54:16.680+0000 7fe4b397ed80 -1 bluestore(/var/lib/ceph/osd/c1-2) _read_fsid unparsable uuid 2020-10-05T11:54:18.852 INFO:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-2 2020-10-05T11:54:18.908 INFO:tasks.ceph:Reading keys from all nodes... 2020-10-05T11:54:18.909 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:18.910 INFO:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/mgr/c1-x/keyring of=/dev/stdout 2020-10-05T11:54:18.952 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo dd if=/var/lib/ceph/mgr/c1-x/keyring of=/dev/stdout 2020-10-05T11:54:18.960 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr.x] 2020-10-05T11:54:18.960 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBhCXtfWtR9LBAA5SF5N5cv6O7TpF/Ld+cO+Q== 2020-10-05T11:54:18.960 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:18.960 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:18.961 INFO:teuthology.orchestra.run.smithi158.stderr:56 bytes copied, 0.000167647 s, 334 kB/s 2020-10-05T11:54:18.961 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:18.962 INFO:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/c1-0/keyring of=/dev/stdout 2020-10-05T11:54:19.008 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo dd if=/var/lib/ceph/osd/c1-0/keyring of=/dev/stdout 2020-10-05T11:54:19.016 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.0] 2020-10-05T11:54:19.016 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBkCXtfWUFvARAAkmF0BuOAvPbagHgZ4lCxJg== 2020-10-05T11:54:19.016 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:19.016 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:19.017 INFO:teuthology.orchestra.run.smithi158.stderr:56 bytes copied, 0.000159493 s, 351 kB/s 2020-10-05T11:54:19.017 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:19.018 INFO:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/c1-1/keyring of=/dev/stdout 2020-10-05T11:54:19.065 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo dd if=/var/lib/ceph/osd/c1-1/keyring of=/dev/stdout 2020-10-05T11:54:19.073 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.1] 2020-10-05T11:54:19.074 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBmCXtfwgVZFhAAIdvFpbivs9W/DPcrevlE+g== 2020-10-05T11:54:19.074 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:19.075 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:19.075 INFO:teuthology.orchestra.run.smithi158.stderr:56 bytes copied, 0.000164078 s, 341 kB/s 2020-10-05T11:54:19.076 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:19.077 INFO:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/c1-2/keyring of=/dev/stdout 2020-10-05T11:54:19.127 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo dd if=/var/lib/ceph/osd/c1-2/keyring of=/dev/stdout 2020-10-05T11:54:19.136 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.2] 2020-10-05T11:54:19.136 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBoCXtfttGxKBAAVYs4aWpmrUz/5lTHi9ozVw== 2020-10-05T11:54:19.136 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:19.136 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:19.136 INFO:teuthology.orchestra.run.smithi158.stderr:56 bytes copied, 0.000155394 s, 360 kB/s 2020-10-05T11:54:19.137 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:19.138 INFO:teuthology.orchestra.run.smithi158:> dd if=/etc/ceph/c1.client.0.keyring of=/dev/stdout 2020-10-05T11:54:19.184 INFO:teuthology.orchestra.run.smithi158.stderr:+ dd if=/etc/ceph/c1.client.0.keyring of=/dev/stdout 2020-10-05T11:54:19.185 INFO:teuthology.orchestra.run.smithi158.stdout:[client.0] 2020-10-05T11:54:19.186 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBhCXtfvaXtMBAAPD5Dasd6j+uINvy8j+FKEw== 2020-10-05T11:54:19.186 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:19.186 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:19.186 INFO:teuthology.orchestra.run.smithi158.stderr:59 bytes copied, 0.000153186 s, 385 kB/s 2020-10-05T11:54:19.187 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:19.187 INFO:teuthology.orchestra.run.smithi158:> dd if=/etc/ceph/c1.client.1.keyring of=/dev/stdout 2020-10-05T11:54:19.233 INFO:teuthology.orchestra.run.smithi158.stderr:+ dd if=/etc/ceph/c1.client.1.keyring of=/dev/stdout 2020-10-05T11:54:19.234 INFO:teuthology.orchestra.run.smithi158.stdout:[client.1] 2020-10-05T11:54:19.234 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBhCXtfnOUvNhAAcjdeiXvftDnTe3XuC6LZgg== 2020-10-05T11:54:19.240 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:19.241 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:19.241 INFO:teuthology.orchestra.run.smithi158.stderr:59 bytes copied, 0.000159107 s, 371 kB/s 2020-10-05T11:54:19.241 INFO:tasks.ceph:Adding keys to all mons... 2020-10-05T11:54:19.242 INFO:teuthology.orchestra.run.smithi158:> sudo tee -a /etc/ceph/c1.keyring 2020-10-05T11:54:19.297 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr.x] 2020-10-05T11:54:19.297 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBhCXtfWtR9LBAA5SF5N5cv6O7TpF/Ld+cO+Q== 2020-10-05T11:54:19.298 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.0] 2020-10-05T11:54:19.298 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBkCXtfWUFvARAAkmF0BuOAvPbagHgZ4lCxJg== 2020-10-05T11:54:19.298 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.1] 2020-10-05T11:54:19.298 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBmCXtfwgVZFhAAIdvFpbivs9W/DPcrevlE+g== 2020-10-05T11:54:19.298 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.2] 2020-10-05T11:54:19.298 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBoCXtfttGxKBAAVYs4aWpmrUz/5lTHi9ozVw== 2020-10-05T11:54:19.298 INFO:teuthology.orchestra.run.smithi158.stdout:[client.0] 2020-10-05T11:54:19.299 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBhCXtfvaXtMBAAPD5Dasd6j+uINvy8j+FKEw== 2020-10-05T11:54:19.299 INFO:teuthology.orchestra.run.smithi158.stdout:[client.1] 2020-10-05T11:54:19.299 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBhCXtfnOUvNhAAcjdeiXvftDnTe3XuC6LZgg== 2020-10-05T11:54:19.300 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-10-05T11:54:19.382 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-05T11:54:19.468 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-05T11:54:19.549 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-05T11:54:19.634 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-10-05T11:54:19.720 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-10-05T11:54:19.808 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-10-05T11:54:19.809 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mon/c1-a 2020-10-05T11:54:19.866 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c1 --mkfs -i a --monmap /home/ubuntu/cephtest/c1.monmap --keyring /etc/ceph/c1.keyring 2020-10-05T11:54:19.963 INFO:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c1-a 2020-10-05T11:54:19.978 INFO:teuthology.orchestra.run.smithi158:> rm -- /home/ubuntu/cephtest/c1.monmap 2020-10-05T11:54:20.026 INFO:tasks.ceph:Starting mon daemons in cluster c1... 2020-10-05T11:54:20.026 INFO:tasks.ceph.c1.mon.a:Restarting daemon 2020-10-05T11:54:20.027 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c1 -i a 2020-10-05T11:54:20.070 INFO:tasks.ceph.c1.mon.a:Started 2020-10-05T11:54:20.071 INFO:tasks.ceph:Starting mgr daemons in cluster c1... 2020-10-05T11:54:20.072 INFO:tasks.ceph.c1.mgr.x:Restarting daemon 2020-10-05T11:54:20.072 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c1 -i x 2020-10-05T11:54:20.075 INFO:tasks.ceph.c1.mgr.x:Started 2020-10-05T11:54:20.075 INFO:tasks.ceph:Setting crush tunables to default 2020-10-05T11:54:20.076 INFO:teuthology.orchestra.run.smithi158:> sudo ceph --cluster c1 osd crush tunables default 2020-10-05T11:54:20.480 INFO:teuthology.orchestra.run.smithi158.stderr:adjusted tunables profile to default 2020-10-05T11:54:20.492 INFO:tasks.ceph:Starting osd daemons in cluster c1... 2020-10-05T11:54:20.493 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:20.493 INFO:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/c1-0/fsid of=/dev/stdout 2020-10-05T11:54:20.496 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo dd if=/var/lib/ceph/osd/c1-0/fsid of=/dev/stdout 2020-10-05T11:54:20.500 INFO:teuthology.orchestra.run.smithi158.stdout:fdc68bd6-4059-441c-889f-1f3af296da01 2020-10-05T11:54:20.501 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:20.501 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:20.501 INFO:teuthology.orchestra.run.smithi158.stderr:37 bytes copied, 0.00022006 s, 168 kB/s 2020-10-05T11:54:20.502 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:20.502 INFO:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/c1-1/fsid of=/dev/stdout 2020-10-05T11:54:20.548 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo dd if=/var/lib/ceph/osd/c1-1/fsid of=/dev/stdout 2020-10-05T11:54:20.556 INFO:teuthology.orchestra.run.smithi158.stdout:99ea6b3c-8439-4ed4-bf3e-9305a298c72d 2020-10-05T11:54:20.556 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:20.557 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:20.557 INFO:teuthology.orchestra.run.smithi158.stderr:37 bytes copied, 0.000177294 s, 209 kB/s 2020-10-05T11:54:20.558 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:20.558 INFO:teuthology.orchestra.run.smithi158:> sudo dd if=/var/lib/ceph/osd/c1-2/fsid of=/dev/stdout 2020-10-05T11:54:20.604 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo dd if=/var/lib/ceph/osd/c1-2/fsid of=/dev/stdout 2020-10-05T11:54:20.613 INFO:teuthology.orchestra.run.smithi158.stdout:75d5bd63-a631-4d73-b12d-8cba0888fea4 2020-10-05T11:54:20.613 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:20.613 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:20.613 INFO:teuthology.orchestra.run.smithi158.stderr:37 bytes copied, 0.000152083 s, 243 kB/s 2020-10-05T11:54:20.614 INFO:teuthology.orchestra.run.smithi158:> sudo ceph --cluster c1 osd new fdc68bd6-4059-441c-889f-1f3af296da01 0 2020-10-05T11:54:20.873 INFO:teuthology.orchestra.run.smithi158.stdout:0 2020-10-05T11:54:20.885 INFO:teuthology.orchestra.run.smithi158:> sudo ceph --cluster c1 osd new 99ea6b3c-8439-4ed4-bf3e-9305a298c72d 1 2020-10-05T11:54:21.092 INFO:teuthology.orchestra.run.smithi158.stdout:1 2020-10-05T11:54:21.104 INFO:teuthology.orchestra.run.smithi158:> sudo ceph --cluster c1 osd new 75d5bd63-a631-4d73-b12d-8cba0888fea4 2 2020-10-05T11:54:21.316 INFO:teuthology.orchestra.run.smithi158.stdout:2 2020-10-05T11:54:21.327 INFO:tasks.ceph.c1.osd.0:Restarting daemon 2020-10-05T11:54:21.328 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 0 2020-10-05T11:54:21.330 INFO:tasks.ceph.c1.osd.0:Started 2020-10-05T11:54:21.330 INFO:tasks.ceph.c1.osd.1:Restarting daemon 2020-10-05T11:54:21.330 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 1 2020-10-05T11:54:21.332 INFO:tasks.ceph.c1.osd.1:Started 2020-10-05T11:54:21.333 INFO:tasks.ceph.c1.osd.2:Restarting daemon 2020-10-05T11:54:21.333 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 2 2020-10-05T11:54:21.335 INFO:tasks.ceph.c1.osd.2:Started 2020-10-05T11:54:21.335 INFO:tasks.ceph:Waiting for OSDs to come up 2020-10-05T11:54:21.639 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2020-10-05T11:54:21.714 INFO:tasks.ceph.c1.osd.0.smithi158.stderr:2020-10-05T11:54:21.712+0000 7fabd64b1d80 -1 Falling back to public interface 2020-10-05T11:54:21.819 INFO:teuthology.misc.health.smithi158.stdout: 2020-10-05T11:54:21.820 INFO:teuthology.misc.health.smithi158.stdout:{"epoch":5,"fsid":"4331870b-f076-4188-a25a-790b1da8adc7","created":"2020-10-05T11:54:20.188467+0000","modified":"2020-10-05T11:54:21.313492+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"fdc68bd6-4059-441c-889f-1f3af296da01","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"99ea6b3c-8439-4ed4-bf3e-9305a298c72d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"75d5bd63-a631-4d73-b12d-8cba0888fea4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-10-05T11:54:21.831 DEBUG:teuthology.misc:0 of 3 OSDs are up 2020-10-05T11:54:21.930 INFO:tasks.ceph.c1.osd.1.smithi158.stderr:2020-10-05T11:54:21.928+0000 7f1e0afc8d80 -1 Falling back to public interface 2020-10-05T11:54:21.950 INFO:tasks.ceph.c1.osd.2.smithi158.stderr:2020-10-05T11:54:21.948+0000 7fed082bed80 -1 Falling back to public interface 2020-10-05T11:54:22.345 INFO:tasks.ceph.c1.osd.0.smithi158.stderr:2020-10-05T11:54:22.344+0000 7fabd64b1d80 -1 osd.0 0 log_to_monitors {default=true} 2020-10-05T11:54:22.571 INFO:tasks.ceph.c1.osd.1.smithi158.stderr:2020-10-05T11:54:22.568+0000 7f1e0afc8d80 -1 osd.1 0 log_to_monitors {default=true} 2020-10-05T11:54:22.590 INFO:tasks.ceph.c1.osd.2.smithi158.stderr:2020-10-05T11:54:22.588+0000 7fed082bed80 -1 osd.2 0 log_to_monitors {default=true} 2020-10-05T11:54:24.220 INFO:tasks.ceph.c1.osd.1.smithi158.stderr:2020-10-05T11:54:24.216+0000 7f1e02493700 -1 osd.1 0 waiting for initial osdmap 2020-10-05T11:54:24.221 INFO:tasks.ceph.c1.osd.2.smithi158.stderr:2020-10-05T11:54:24.216+0000 7fecff789700 -1 osd.2 0 waiting for initial osdmap 2020-10-05T11:54:24.221 INFO:tasks.ceph.c1.osd.0.smithi158.stderr:2020-10-05T11:54:24.216+0000 7fabcd97c700 -1 osd.0 0 waiting for initial osdmap 2020-10-05T11:54:28.133 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2020-10-05T11:54:28.413 INFO:teuthology.misc.health.smithi158.stdout: 2020-10-05T11:54:28.413 INFO:teuthology.misc.health.smithi158.stdout:{"epoch":10,"fsid":"4331870b-f076-4188-a25a-790b1da8adc7","created":"2020-10-05T11:54:20.188467+0000","modified":"2020-10-05T11:54:27.237558+0000","last_up_change":"2020-10-05T11:54:25.215293+0000","last_in_change":"2020-10-05T11:54:25.215293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-05T11:54:23.978907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"fdc68bd6-4059-441c-889f-1f3af296da01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":11997},{"type":"v1","addr":"172.21.15.158:6801","nonce":11997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":11997},{"type":"v1","addr":"172.21.15.158:6803","nonce":11997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":11997},{"type":"v1","addr":"172.21.15.158:6807","nonce":11997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":11997},{"type":"v1","addr":"172.21.15.158:6805","nonce":11997}]},"public_addr":"172.21.15.158:6801/11997","cluster_addr":"172.21.15.158:6803/11997","heartbeat_back_addr":"172.21.15.158:6807/11997","heartbeat_front_addr":"172.21.15.158:6805/11997","state":["exists","up"]},{"osd":1,"uuid":"99ea6b3c-8439-4ed4-bf3e-9305a298c72d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":11996},{"type":"v1","addr":"172.21.15.158:6809","nonce":11996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":11996},{"type":"v1","addr":"172.21.15.158:6811","nonce":11996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":11996},{"type":"v1","addr":"172.21.15.158:6815","nonce":11996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":11996},{"type":"v1","addr":"172.21.15.158:6813","nonce":11996}]},"public_addr":"172.21.15.158:6809/11996","cluster_addr":"172.21.15.158:6811/11996","heartbeat_back_addr":"172.21.15.158:6815/11996","heartbeat_front_addr":"172.21.15.158:6813/11996","state":["exists","up"]},{"osd":2,"uuid":"75d5bd63-a631-4d73-b12d-8cba0888fea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12012},{"type":"v1","addr":"172.21.15.158:6817","nonce":12012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12012},{"type":"v1","addr":"172.21.15.158:6819","nonce":12012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12012},{"type":"v1","addr":"172.21.15.158:6823","nonce":12012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12012},{"type":"v1","addr":"172.21.15.158:6821","nonce":12012}]},"public_addr":"172.21.15.158:6817/12012","cluster_addr":"172.21.15.158:6819/12012","heartbeat_back_addr":"172.21.15.158:6823/12012","heartbeat_front_addr":"172.21.15.158:6821/12012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:23.370680+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:23.592522+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:23.555060+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-10-05T11:54:28.432 DEBUG:teuthology.misc:3 of 3 OSDs are up 2020-10-05T11:54:28.432 INFO:tasks.ceph:Creating RBD pool 2020-10-05T11:54:28.433 INFO:teuthology.orchestra.run.smithi158:> sudo ceph --cluster c1 osd pool create rbd 8 2020-10-05T11:54:29.273 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'rbd' created 2020-10-05T11:54:29.287 INFO:teuthology.orchestra.run.smithi158:> sudo ceph --cluster c1 osd pool application enable rbd rbd --yes-i-really-mean-it 2020-10-05T11:54:30.284 INFO:teuthology.orchestra.run.smithi158.stderr:enabled application 'rbd' on pool 'rbd' 2020-10-05T11:54:30.298 INFO:tasks.ceph:Starting mds daemons in cluster c1... 2020-10-05T11:54:30.299 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early osd dump --format=json 2020-10-05T11:54:30.299 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-10-05T11:54:30.581 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:30.582 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":12,"fsid":"4331870b-f076-4188-a25a-790b1da8adc7","created":"2020-10-05T11:54:20.188467+0000","modified":"2020-10-05T11:54:30.261119+0000","last_up_change":"2020-10-05T11:54:25.215293+0000","last_in_change":"2020-10-05T11:54:25.215293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-05T11:54:23.978907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-05T11:54:28.716133+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"fdc68bd6-4059-441c-889f-1f3af296da01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":11997},{"type":"v1","addr":"172.21.15.158:6801","nonce":11997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":11997},{"type":"v1","addr":"172.21.15.158:6803","nonce":11997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":11997},{"type":"v1","addr":"172.21.15.158:6807","nonce":11997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":11997},{"type":"v1","addr":"172.21.15.158:6805","nonce":11997}]},"public_addr":"172.21.15.158:6801/11997","cluster_addr":"172.21.15.158:6803/11997","heartbeat_back_addr":"172.21.15.158:6807/11997","heartbeat_front_addr":"172.21.15.158:6805/11997","state":["exists","up"]},{"osd":1,"uuid":"99ea6b3c-8439-4ed4-bf3e-9305a298c72d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":11996},{"type":"v1","addr":"172.21.15.158:6809","nonce":11996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":11996},{"type":"v1","addr":"172.21.15.158:6811","nonce":11996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":11996},{"type":"v1","addr":"172.21.15.158:6815","nonce":11996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":11996},{"type":"v1","addr":"172.21.15.158:6813","nonce":11996}]},"public_addr":"172.21.15.158:6809/11996","cluster_addr":"172.21.15.158:6811/11996","heartbeat_back_addr":"172.21.15.158:6815/11996","heartbeat_front_addr":"172.21.15.158:6813/11996","state":["exists","up"]},{"osd":2,"uuid":"75d5bd63-a631-4d73-b12d-8cba0888fea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12012},{"type":"v1","addr":"172.21.15.158:6817","nonce":12012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12012},{"type":"v1","addr":"172.21.15.158:6819","nonce":12012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12012},{"type":"v1","addr":"172.21.15.158:6823","nonce":12012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12012},{"type":"v1","addr":"172.21.15.158:6821","nonce":12012}]},"public_addr":"172.21.15.158:6817/12012","cluster_addr":"172.21.15.158:6819/12012","heartbeat_back_addr":"172.21.15.158:6823/12012","heartbeat_front_addr":"172.21.15.158:6821/12012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:23.370680+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:23.592522+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:23.555060+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-10-05T11:54:30.595 INFO:tasks.ceph.ceph_manager.c1:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-05T11:54:23.978907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-05T11:54:28.716133+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-05T11:54:30.596 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early osd pool get device_health_metrics pg_num 2020-10-05T11:54:30.889 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 1 2020-10-05T11:54:30.904 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early osd pool get rbd pg_num 2020-10-05T11:54:31.191 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2020-10-05T11:54:31.213 INFO:tasks.ceph:Waiting until c1 daemons up and pgs clean... 2020-10-05T11:54:31.213 INFO:tasks.ceph.ceph_manager.c1:waiting for mgr available 2020-10-05T11:54:31.213 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early mgr dump --format=json 2020-10-05T11:54:31.542 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:31.556 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":4,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":11813},{"type":"v1","addr":"172.21.15.158:6825","nonce":11813}]},"active_addr":"172.21.15.158:6825/11813","active_change":"2020-10-05T11:54:23.954542+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.158:0","nonce":1680798932}]},{"addrvec":[{"type":"v2","addr":"172.21.15.158:0","nonce":4215681778}]},{"addrvec":[{"type":"v2","addr":"172.21.15.158:0","nonce":914162810}]}]}} 2020-10-05T11:54:31.558 INFO:tasks.ceph.ceph_manager.c1:mgr available! 2020-10-05T11:54:31.559 INFO:tasks.ceph.ceph_manager.c1:waiting for all up 2020-10-05T11:54:31.559 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early osd dump --format=json 2020-10-05T11:54:31.848 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:31.849 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":13,"fsid":"4331870b-f076-4188-a25a-790b1da8adc7","created":"2020-10-05T11:54:20.188467+0000","modified":"2020-10-05T11:54:31.268034+0000","last_up_change":"2020-10-05T11:54:25.215293+0000","last_in_change":"2020-10-05T11:54:25.215293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-05T11:54:23.978907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-05T11:54:28.716133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"fdc68bd6-4059-441c-889f-1f3af296da01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":11997},{"type":"v1","addr":"172.21.15.158:6801","nonce":11997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":11997},{"type":"v1","addr":"172.21.15.158:6803","nonce":11997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":11997},{"type":"v1","addr":"172.21.15.158:6807","nonce":11997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":11997},{"type":"v1","addr":"172.21.15.158:6805","nonce":11997}]},"public_addr":"172.21.15.158:6801/11997","cluster_addr":"172.21.15.158:6803/11997","heartbeat_back_addr":"172.21.15.158:6807/11997","heartbeat_front_addr":"172.21.15.158:6805/11997","state":["exists","up"]},{"osd":1,"uuid":"99ea6b3c-8439-4ed4-bf3e-9305a298c72d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":11996},{"type":"v1","addr":"172.21.15.158:6809","nonce":11996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":11996},{"type":"v1","addr":"172.21.15.158:6811","nonce":11996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":11996},{"type":"v1","addr":"172.21.15.158:6815","nonce":11996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":11996},{"type":"v1","addr":"172.21.15.158:6813","nonce":11996}]},"public_addr":"172.21.15.158:6809/11996","cluster_addr":"172.21.15.158:6811/11996","heartbeat_back_addr":"172.21.15.158:6815/11996","heartbeat_front_addr":"172.21.15.158:6813/11996","state":["exists","up"]},{"osd":2,"uuid":"75d5bd63-a631-4d73-b12d-8cba0888fea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12012},{"type":"v1","addr":"172.21.15.158:6817","nonce":12012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12012},{"type":"v1","addr":"172.21.15.158:6819","nonce":12012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12012},{"type":"v1","addr":"172.21.15.158:6823","nonce":12012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12012},{"type":"v1","addr":"172.21.15.158:6821","nonce":12012}]},"public_addr":"172.21.15.158:6817/12012","cluster_addr":"172.21.15.158:6819/12012","heartbeat_back_addr":"172.21.15.158:6823/12012","heartbeat_front_addr":"172.21.15.158:6821/12012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:23.370680+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:23.592522+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:23.555060+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-10-05T11:54:31.862 INFO:tasks.ceph.ceph_manager.c1:all up! 2020-10-05T11:54:31.863 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early osd dump --format=json 2020-10-05T11:54:32.148 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:32.149 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":13,"fsid":"4331870b-f076-4188-a25a-790b1da8adc7","created":"2020-10-05T11:54:20.188467+0000","modified":"2020-10-05T11:54:31.268034+0000","last_up_change":"2020-10-05T11:54:25.215293+0000","last_in_change":"2020-10-05T11:54:25.215293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-05T11:54:23.978907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-05T11:54:28.716133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"fdc68bd6-4059-441c-889f-1f3af296da01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":11997},{"type":"v1","addr":"172.21.15.158:6801","nonce":11997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":11997},{"type":"v1","addr":"172.21.15.158:6803","nonce":11997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":11997},{"type":"v1","addr":"172.21.15.158:6807","nonce":11997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":11997},{"type":"v1","addr":"172.21.15.158:6805","nonce":11997}]},"public_addr":"172.21.15.158:6801/11997","cluster_addr":"172.21.15.158:6803/11997","heartbeat_back_addr":"172.21.15.158:6807/11997","heartbeat_front_addr":"172.21.15.158:6805/11997","state":["exists","up"]},{"osd":1,"uuid":"99ea6b3c-8439-4ed4-bf3e-9305a298c72d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":11996},{"type":"v1","addr":"172.21.15.158:6809","nonce":11996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":11996},{"type":"v1","addr":"172.21.15.158:6811","nonce":11996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":11996},{"type":"v1","addr":"172.21.15.158:6815","nonce":11996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":11996},{"type":"v1","addr":"172.21.15.158:6813","nonce":11996}]},"public_addr":"172.21.15.158:6809/11996","cluster_addr":"172.21.15.158:6811/11996","heartbeat_back_addr":"172.21.15.158:6815/11996","heartbeat_front_addr":"172.21.15.158:6813/11996","state":["exists","up"]},{"osd":2,"uuid":"75d5bd63-a631-4d73-b12d-8cba0888fea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12012},{"type":"v1","addr":"172.21.15.158:6817","nonce":12012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12012},{"type":"v1","addr":"172.21.15.158:6819","nonce":12012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12012},{"type":"v1","addr":"172.21.15.158:6823","nonce":12012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12012},{"type":"v1","addr":"172.21.15.158:6821","nonce":12012}]},"public_addr":"172.21.15.158:6817/12012","cluster_addr":"172.21.15.158:6819/12012","heartbeat_back_addr":"172.21.15.158:6823/12012","heartbeat_front_addr":"172.21.15.158:6821/12012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:23.370680+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:23.592522+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:23.555060+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-10-05T11:54:32.163 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early tell osd.0 flush_pg_stats 2020-10-05T11:54:32.331 INFO:teuthology.orchestra.run.smithi158.stdout:34359738371 2020-10-05T11:54:32.332 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early tell osd.1 flush_pg_stats 2020-10-05T11:54:32.495 INFO:teuthology.orchestra.run.smithi158.stdout:34359738372 2020-10-05T11:54:32.495 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early tell osd.2 flush_pg_stats 2020-10-05T11:54:32.664 INFO:teuthology.orchestra.run.smithi158.stdout:34359738372 2020-10-05T11:54:32.665 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early osd last-stat-seq osd.0 2020-10-05T11:54:32.951 INFO:teuthology.orchestra.run.smithi158.stdout:34359738370 2020-10-05T11:54:32.964 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738371 got 34359738370 for osd.0 2020-10-05T11:54:33.965 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early osd last-stat-seq osd.0 2020-10-05T11:54:34.324 INFO:teuthology.orchestra.run.smithi158.stdout:34359738371 2020-10-05T11:54:34.338 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738371 got 34359738371 for osd.0 2020-10-05T11:54:34.338 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early osd last-stat-seq osd.1 2020-10-05T11:54:34.614 INFO:teuthology.orchestra.run.smithi158.stdout:34359738372 2020-10-05T11:54:34.628 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738372 for osd.1 2020-10-05T11:54:34.629 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early osd last-stat-seq osd.2 2020-10-05T11:54:34.912 INFO:teuthology.orchestra.run.smithi158.stdout:34359738372 2020-10-05T11:54:34.926 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738372 for osd.2 2020-10-05T11:54:34.926 INFO:tasks.ceph.ceph_manager.c1:waiting for clean 2020-10-05T11:54:34.926 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early pg dump --format=json 2020-10-05T11:54:35.208 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:35.210 INFO:teuthology.orchestra.run.smithi158.stderr:dumped all 2020-10-05T11:54:35.222 INFO:teuthology.orchestra.run.smithi158.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2020-10-05T11:54:33.965144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":14688,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":314558112,"statfs":{"total":322122547200,"available":322107506688,"internally_reserved":0,"allocated":335872,"data_stored":95895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.694838"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.286770+0000","last_change":"2020-10-05T11:54:30.285408+0000","last_active":"2020-10-05T11:54:30.286770+0000","last_peered":"2020-10-05T11:54:30.286770+0000","last_clean":"2020-10-05T11:54:30.286770+0000","last_became_active":"2020-10-05T11:54:30.284940+0000","last_became_peered":"2020-10-05T11:54:30.284940+0000","last_unstale":"2020-10-05T11:54:30.286770+0000","last_undegraded":"2020-10-05T11:54:30.286770+0000","last_fullsized":"2020-10-05T11:54:30.286770+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.283005+0000","last_change":"2020-10-05T11:54:30.281939+0000","last_active":"2020-10-05T11:54:30.283005+0000","last_peered":"2020-10-05T11:54:30.283005+0000","last_clean":"2020-10-05T11:54:30.283005+0000","last_became_active":"2020-10-05T11:54:30.281497+0000","last_became_peered":"2020-10-05T11:54:30.281497+0000","last_unstale":"2020-10-05T11:54:30.283005+0000","last_undegraded":"2020-10-05T11:54:30.283005+0000","last_fullsized":"2020-10-05T11:54:30.283005+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.284977+0000","last_change":"2020-10-05T11:54:30.282939+0000","last_active":"2020-10-05T11:54:30.284977+0000","last_peered":"2020-10-05T11:54:30.284977+0000","last_clean":"2020-10-05T11:54:30.284977+0000","last_became_active":"2020-10-05T11:54:30.282122+0000","last_became_peered":"2020-10-05T11:54:30.282122+0000","last_unstale":"2020-10-05T11:54:30.284977+0000","last_undegraded":"2020-10-05T11:54:30.284977+0000","last_fullsized":"2020-10-05T11:54:30.284977+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.284059+0000","last_change":"2020-10-05T11:54:30.280992+0000","last_active":"2020-10-05T11:54:30.284059+0000","last_peered":"2020-10-05T11:54:30.284059+0000","last_clean":"2020-10-05T11:54:30.284059+0000","last_became_active":"2020-10-05T11:54:30.280468+0000","last_became_peered":"2020-10-05T11:54:30.280468+0000","last_unstale":"2020-10-05T11:54:30.284059+0000","last_undegraded":"2020-10-05T11:54:30.284059+0000","last_fullsized":"2020-10-05T11:54:30.284059+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"9'1","reported_seq":"12","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.278111+0000","last_change":"2020-10-05T11:54:26.337513+0000","last_active":"2020-10-05T11:54:30.278111+0000","last_peered":"2020-10-05T11:54:30.278111+0000","last_clean":"2020-10-05T11:54:30.278111+0000","last_became_active":"2020-10-05T11:54:26.335812+0000","last_became_peered":"2020-10-05T11:54:26.335812+0000","last_unstale":"2020-10-05T11:54:30.278111+0000","last_undegraded":"2020-10-05T11:54:30.278111+0000","last_fullsized":"2020-10-05T11:54:30.278111+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:24.207355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:24.207355+0000","last_clean_scrub_stamp":"2020-10-05T11:54:24.207355+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.285001+0000","last_change":"2020-10-05T11:54:30.282901+0000","last_active":"2020-10-05T11:54:30.285001+0000","last_peered":"2020-10-05T11:54:30.285001+0000","last_clean":"2020-10-05T11:54:30.285001+0000","last_became_active":"2020-10-05T11:54:30.282621+0000","last_became_peered":"2020-10-05T11:54:30.282621+0000","last_unstale":"2020-10-05T11:54:30.285001+0000","last_undegraded":"2020-10-05T11:54:30.285001+0000","last_fullsized":"2020-10-05T11:54:30.285001+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.283187+0000","last_change":"2020-10-05T11:54:30.280655+0000","last_active":"2020-10-05T11:54:30.283187+0000","last_peered":"2020-10-05T11:54:30.283187+0000","last_clean":"2020-10-05T11:54:30.283187+0000","last_became_active":"2020-10-05T11:54:30.280174+0000","last_became_peered":"2020-10-05T11:54:30.280174+0000","last_unstale":"2020-10-05T11:54:30.283187+0000","last_undegraded":"2020-10-05T11:54:30.283187+0000","last_fullsized":"2020-10-05T11:54:30.283187+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.283176+0000","last_change":"2020-10-05T11:54:30.281953+0000","last_active":"2020-10-05T11:54:30.283176+0000","last_peered":"2020-10-05T11:54:30.283176+0000","last_clean":"2020-10-05T11:54:30.283176+0000","last_became_active":"2020-10-05T11:54:30.281713+0000","last_became_peered":"2020-10-05T11:54:30.281713+0000","last_unstale":"2020-10-05T11:54:30.283176+0000","last_undegraded":"2020-10-05T11:54:30.283176+0000","last_fullsized":"2020-10-05T11:54:30.283176+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.285046+0000","last_change":"2020-10-05T11:54:30.282993+0000","last_active":"2020-10-05T11:54:30.285046+0000","last_peered":"2020-10-05T11:54:30.285046+0000","last_clean":"2020-10-05T11:54:30.285046+0000","last_became_active":"2020-10-05T11:54:30.282451+0000","last_became_peered":"2020-10-05T11:54:30.282451+0000","last_unstale":"2020-10-05T11:54:30.285046+0000","last_undegraded":"2020-10-05T11:54:30.285046+0000","last_fullsized":"2020-10-05T11:54:30.285046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4856,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":104852744,"statfs":{"total":107374182400,"available":107369209856,"internally_reserved":0,"allocated":114688,"data_stored":33136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.659}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4912,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852688,"statfs":{"total":107374182400,"available":107369152512,"internally_reserved":0,"allocated":106496,"data_stored":29623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.885}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4920,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852680,"statfs":{"total":107374182400,"available":107369144320,"internally_reserved":0,"allocated":114688,"data_stored":33136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]}]}} 2020-10-05T11:54:35.223 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early pg dump --format=json 2020-10-05T11:54:35.509 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:35.511 INFO:teuthology.orchestra.run.smithi158.stderr:dumped all 2020-10-05T11:54:35.523 INFO:teuthology.orchestra.run.smithi158.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2020-10-05T11:54:33.965144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":14688,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":314558112,"statfs":{"total":322122547200,"available":322107506688,"internally_reserved":0,"allocated":335872,"data_stored":95895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.694838"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.286770+0000","last_change":"2020-10-05T11:54:30.285408+0000","last_active":"2020-10-05T11:54:30.286770+0000","last_peered":"2020-10-05T11:54:30.286770+0000","last_clean":"2020-10-05T11:54:30.286770+0000","last_became_active":"2020-10-05T11:54:30.284940+0000","last_became_peered":"2020-10-05T11:54:30.284940+0000","last_unstale":"2020-10-05T11:54:30.286770+0000","last_undegraded":"2020-10-05T11:54:30.286770+0000","last_fullsized":"2020-10-05T11:54:30.286770+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.283005+0000","last_change":"2020-10-05T11:54:30.281939+0000","last_active":"2020-10-05T11:54:30.283005+0000","last_peered":"2020-10-05T11:54:30.283005+0000","last_clean":"2020-10-05T11:54:30.283005+0000","last_became_active":"2020-10-05T11:54:30.281497+0000","last_became_peered":"2020-10-05T11:54:30.281497+0000","last_unstale":"2020-10-05T11:54:30.283005+0000","last_undegraded":"2020-10-05T11:54:30.283005+0000","last_fullsized":"2020-10-05T11:54:30.283005+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.284977+0000","last_change":"2020-10-05T11:54:30.282939+0000","last_active":"2020-10-05T11:54:30.284977+0000","last_peered":"2020-10-05T11:54:30.284977+0000","last_clean":"2020-10-05T11:54:30.284977+0000","last_became_active":"2020-10-05T11:54:30.282122+0000","last_became_peered":"2020-10-05T11:54:30.282122+0000","last_unstale":"2020-10-05T11:54:30.284977+0000","last_undegraded":"2020-10-05T11:54:30.284977+0000","last_fullsized":"2020-10-05T11:54:30.284977+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.284059+0000","last_change":"2020-10-05T11:54:30.280992+0000","last_active":"2020-10-05T11:54:30.284059+0000","last_peered":"2020-10-05T11:54:30.284059+0000","last_clean":"2020-10-05T11:54:30.284059+0000","last_became_active":"2020-10-05T11:54:30.280468+0000","last_became_peered":"2020-10-05T11:54:30.280468+0000","last_unstale":"2020-10-05T11:54:30.284059+0000","last_undegraded":"2020-10-05T11:54:30.284059+0000","last_fullsized":"2020-10-05T11:54:30.284059+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"9'1","reported_seq":"12","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.278111+0000","last_change":"2020-10-05T11:54:26.337513+0000","last_active":"2020-10-05T11:54:30.278111+0000","last_peered":"2020-10-05T11:54:30.278111+0000","last_clean":"2020-10-05T11:54:30.278111+0000","last_became_active":"2020-10-05T11:54:26.335812+0000","last_became_peered":"2020-10-05T11:54:26.335812+0000","last_unstale":"2020-10-05T11:54:30.278111+0000","last_undegraded":"2020-10-05T11:54:30.278111+0000","last_fullsized":"2020-10-05T11:54:30.278111+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:24.207355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:24.207355+0000","last_clean_scrub_stamp":"2020-10-05T11:54:24.207355+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.285001+0000","last_change":"2020-10-05T11:54:30.282901+0000","last_active":"2020-10-05T11:54:30.285001+0000","last_peered":"2020-10-05T11:54:30.285001+0000","last_clean":"2020-10-05T11:54:30.285001+0000","last_became_active":"2020-10-05T11:54:30.282621+0000","last_became_peered":"2020-10-05T11:54:30.282621+0000","last_unstale":"2020-10-05T11:54:30.285001+0000","last_undegraded":"2020-10-05T11:54:30.285001+0000","last_fullsized":"2020-10-05T11:54:30.285001+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.283187+0000","last_change":"2020-10-05T11:54:30.280655+0000","last_active":"2020-10-05T11:54:30.283187+0000","last_peered":"2020-10-05T11:54:30.283187+0000","last_clean":"2020-10-05T11:54:30.283187+0000","last_became_active":"2020-10-05T11:54:30.280174+0000","last_became_peered":"2020-10-05T11:54:30.280174+0000","last_unstale":"2020-10-05T11:54:30.283187+0000","last_undegraded":"2020-10-05T11:54:30.283187+0000","last_fullsized":"2020-10-05T11:54:30.283187+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.283176+0000","last_change":"2020-10-05T11:54:30.281953+0000","last_active":"2020-10-05T11:54:30.283176+0000","last_peered":"2020-10-05T11:54:30.283176+0000","last_clean":"2020-10-05T11:54:30.283176+0000","last_became_active":"2020-10-05T11:54:30.281713+0000","last_became_peered":"2020-10-05T11:54:30.281713+0000","last_unstale":"2020-10-05T11:54:30.283176+0000","last_undegraded":"2020-10-05T11:54:30.283176+0000","last_fullsized":"2020-10-05T11:54:30.283176+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:30.285046+0000","last_change":"2020-10-05T11:54:30.282993+0000","last_active":"2020-10-05T11:54:30.285046+0000","last_peered":"2020-10-05T11:54:30.285046+0000","last_clean":"2020-10-05T11:54:30.285046+0000","last_became_active":"2020-10-05T11:54:30.282451+0000","last_became_peered":"2020-10-05T11:54:30.282451+0000","last_unstale":"2020-10-05T11:54:30.285046+0000","last_undegraded":"2020-10-05T11:54:30.285046+0000","last_fullsized":"2020-10-05T11:54:30.285046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:29.252637+0000","last_clean_scrub_stamp":"2020-10-05T11:54:29.252637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4856,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":104852744,"statfs":{"total":107374182400,"available":107369209856,"internally_reserved":0,"allocated":114688,"data_stored":33136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.659}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4912,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852688,"statfs":{"total":107374182400,"available":107369152512,"internally_reserved":0,"allocated":106496,"data_stored":29623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.885}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4920,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852680,"statfs":{"total":107374182400,"available":107369144320,"internally_reserved":0,"allocated":114688,"data_stored":33136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]}]}} 2020-10-05T11:54:35.524 INFO:tasks.ceph.ceph_manager.c1:clean! 2020-10-05T11:54:35.525 INFO:tasks.ceph:Waiting until ceph cluster c1 is healthy... 2020-10-05T11:54:35.525 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy 2020-10-05T11:54:35.525 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early health --format=json 2020-10-05T11:54:35.856 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:35.870 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-10-05T11:54:35.871 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy done 2020-10-05T11:54:35.871 INFO:teuthology.run_tasks:Running task ceph... 2020-10-05T11:54:35.881 INFO:tasks.ceph:Creating ceph cluster c2... 2020-10-05T11:54:35.881 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(PG_AVAILABILITY\\)'], 'cpu_profile': set(), 'cluster': 'c2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-10-05T11:54:35.881 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuvalif-2020-10-05_09:58:27-rgw-wip-yuval-static-analysis-distro-basic-smithi/5498204', 'branch': 'wip-yuval-static-analysis', 'description': 'rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '5498204', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuvalif-2020-10-05_09:58:27-rgw-wip-yuval-static-analysis-distro-basic-smithi', 'nuke-on-error': True, 'os_type': 'ubuntu', 'overrides': {'admin_socket': {'branch': 'wip-yuval-static-analysis'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c1.client.1'], 'name': 'test-zone3'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone4'}]}]}, 'workunit': {'branch': 'wip-yuval-static-analysis', 'sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba'}}, 'owner': 'scheduled_yuvalif@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-yuval-static-analysis', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-static-analysis/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b726425d5bff271f4fe469ee94a9b80f7cad00ba', 'wait-for-scrub': False}}, {'rgw': {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'tube': 'smithi', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.24691', 'targets': {'smithi158.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDM+8gyKqtLyk2huQLscFyLhmJAZIlrCwlzCS6kd634CdB5K14NA8AL38jqIQN8zibklKO3OayBU+YotcLsmPxMF6iRMZygMQM71LAdmH0MxiXKjN4fbaEC01ca+ILhynWAnnQtm4u41IPTifYjFcodkHFR0vU88g6j6RlWb2n0Vur+QVvfkjQ43KHToaA+eQ0BhAjzLuQ4W5UJz59MZS84tvuk9ap4r6rzloRHcXisFcRaXn5k9AsEHMsWKUICxdtO3ksVXn5dBmGNQqSx91tZ18+zbthU7MBDwTArb1465TLCD+br4yKIaLnlhRIiwPRrC9fHFzzXk6qaQlnpkZfN', 'smithi081.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSw/9O7CI4W2dWnjnOZxzsRsbd5XrpT8KDTWzX4fLmtu1iO0qqFnAZQiDLhrm7L0sKL1nhRx45Oz1JSRoBKv+31Ncpb3KzmaugaS4V2fQvgMaB3cy86EbX0CMYsyKVoHq600SgP0GRWoR8EUL+P4zycaGiLm5hPzH6swIFXNjqb5WmybLHwrw5vv3308PmVbOISaaA0ZknAt5LruOpH28au5Aa5Q8f6SWOOvv4IEVXv4ASV890FLAn6alJuGkx9kCIqqMqwVt65LcFuNnvFcvXpkHYygIOUlP3wuTdBZS8WLWEkBvrG2A4GufkHdGbcT54T9tv3d2EJl0cEy0qnraP'}} 2020-10-05T11:54:35.882 INFO:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2020-10-05T11:54:35.884 INFO:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2020-10-05T11:54:35.891 INFO:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2020-10-05T11:54:35.931 INFO:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/run/ceph 2020-10-05T11:54:35.945 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:35.945 INFO:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2020-10-05T11:54:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-10-05T11:54:35.991 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/vg_nvme/lv_1 2020-10-05T11:54:35.991 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/vg_nvme/lv_2 2020-10-05T11:54:35.991 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/vg_nvme/lv_3 2020-10-05T11:54:35.992 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/vg_nvme/lv_4 2020-10-05T11:54:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:72 bytes copied, 0.00017826 s, 404 kB/s 2020-10-05T11:54:35.992 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-10-05T11:54:35.993 INFO:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-10-05T11:54:36.040 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-10-05T11:54:36.040 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-05T11:54:36.040 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 345 Links: 1 2020-10-05T11:54:36.040 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-05T11:54:36.041 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2020-10-05 11:51:49.175569578 +0000 2020-10-05T11:54:36.041 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2020-10-05 11:51:49.095569580 +0000 2020-10-05T11:54:36.041 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2020-10-05 11:51:49.095569580 +0000 2020-10-05T11:54:36.041 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2020-10-05T11:54:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2020-10-05T11:54:36.050 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2020-10-05T11:54:36.050 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000357477 s, 1.4 MB/s 2020-10-05T11:54:36.053 INFO:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-10-05T11:54:36.100 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-10-05T11:54:36.100 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-05T11:54:36.100 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 352 Links: 1 2020-10-05T11:54:36.100 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-05T11:54:36.101 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2020-10-05 11:51:49.319569575 +0000 2020-10-05T11:54:36.101 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2020-10-05 11:51:49.315569575 +0000 2020-10-05T11:54:36.101 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2020-10-05 11:51:49.315569575 +0000 2020-10-05T11:54:36.101 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2020-10-05T11:54:36.110 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2020-10-05T11:54:36.110 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2020-10-05T11:54:36.110 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00029143 s, 1.8 MB/s 2020-10-05T11:54:36.113 INFO:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-10-05T11:54:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-10-05T11:54:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-05T11:54:36.161 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 358 Links: 1 2020-10-05T11:54:36.161 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-05T11:54:36.161 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2020-10-05 11:51:49.555569570 +0000 2020-10-05T11:54:36.161 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2020-10-05 11:51:49.551569570 +0000 2020-10-05T11:54:36.161 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2020-10-05 11:51:49.551569570 +0000 2020-10-05T11:54:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2020-10-05T11:54:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2020-10-05T11:54:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2020-10-05T11:54:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00039143 s, 1.3 MB/s 2020-10-05T11:54:36.174 INFO:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-10-05T11:54:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-10-05T11:54:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-05T11:54:36.224 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 364 Links: 1 2020-10-05T11:54:36.225 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-05T11:54:36.225 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2020-10-05 11:51:49.915569562 +0000 2020-10-05T11:54:36.225 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2020-10-05 11:51:49.799569564 +0000 2020-10-05T11:54:36.225 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2020-10-05 11:51:49.799569564 +0000 2020-10-05T11:54:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2020-10-05T11:54:36.233 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2020-10-05T11:54:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2020-10-05T11:54:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000429061 s, 1.2 MB/s 2020-10-05T11:54:36.237 INFO:tasks.ceph:osd dev map: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2020-10-05T11:54:36.237 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2020-10-05T11:54:36.237 INFO:tasks.ceph:Generating config... 2020-10-05T11:54:36.239 INFO:tasks.ceph:[client] debug rgw = 20 2020-10-05T11:54:36.239 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2020-10-05T11:54:36.239 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2020-10-05T11:54:36.239 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2020-10-05T11:54:36.239 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2020-10-05T11:54:36.240 INFO:tasks.ceph:[client] rgw data log num shards = 4 2020-10-05T11:54:36.240 INFO:tasks.ceph:[client] rgw md log max shards = 4 2020-10-05T11:54:36.240 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2020-10-05T11:54:36.240 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2020-10-05T11:54:36.240 INFO:tasks.ceph:[client] setgroup = ceph 2020-10-05T11:54:36.241 INFO:tasks.ceph:[client] setuser = ceph 2020-10-05T11:54:36.241 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2020-10-05T11:54:36.241 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-10-05T11:54:36.241 INFO:tasks.ceph:[mgr] debug ms = 1 2020-10-05T11:54:36.241 INFO:tasks.ceph:[mon] debug mon = 20 2020-10-05T11:54:36.242 INFO:tasks.ceph:[mon] debug ms = 1 2020-10-05T11:54:36.242 INFO:tasks.ceph:[mon] debug paxos = 20 2020-10-05T11:54:36.242 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2020-10-05T11:54:36.242 INFO:tasks.ceph:[osd] debug filestore = 20 2020-10-05T11:54:36.242 INFO:tasks.ceph:[osd] debug journal = 20 2020-10-05T11:54:36.243 INFO:tasks.ceph:[osd] debug ms = 20 2020-10-05T11:54:36.243 INFO:tasks.ceph:[osd] debug osd = 25 2020-10-05T11:54:36.243 INFO:tasks.ceph:[osd] osd fast shutdown = False 2020-10-05T11:54:36.243 INFO:tasks.ceph:[osd] rocksdb delete range threshold = 0 2020-10-05T11:54:36.243 INFO:tasks.ceph:[osd.0] osd_max_omap_entries_per_request = 10 2020-10-05T11:54:36.244 INFO:tasks.ceph:[osd.1] osd_max_omap_entries_per_request = 1000 2020-10-05T11:54:36.244 INFO:tasks.ceph:[osd.2] osd_max_omap_entries_per_request = 10000 2020-10-05T11:54:36.244 INFO:tasks.ceph:Setting up c2.mon.a... 2020-10-05T11:54:36.244 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c2.keyring 2020-10-05T11:54:36.311 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/c2.keyring 2020-10-05T11:54:36.313 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c2.keyring 2020-10-05T11:54:36.386 INFO:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/c2.keyring 2020-10-05T11:54:36.448 DEBUG:tasks.ceph:Ceph mon addresses: [('c2.mon.a', '172.21.15.81')] 2020-10-05T11:54:36.449 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon host': '172.21.15.81', 'osd heartbeat grace': 40}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False, 'rocksdb delete range threshold': 0}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}} 2020-10-05T11:54:36.450 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:36.450 INFO:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-10-05T11:54:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:+ dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-10-05T11:54:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:6+1 records in 2020-10-05T11:54:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:6+1 records out 2020-10-05T11:54:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:3100 bytes (3.1 kB, 3.0 KiB) copied, 0.00010609 s, 29.2 MB/s 2020-10-05T11:54:36.496 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --print /home/ubuntu/cephtest/c2.monmap 2020-10-05T11:54:36.566 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:54:36.567 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:54:36.567 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c2.monmap 2020-10-05T11:54:36.568 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid 7aabd69d-1bd4-492d-8378-46a0a5b6b398 2020-10-05T11:54:36.568 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2020-10-05T11:54:36.568 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 7aabd69d-1bd4-492d-8378-46a0a5b6b398 2020-10-05T11:54:36.568 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2020-10-05T11:54:36.569367+0000 2020-10-05T11:54:36.569 INFO:teuthology.orchestra.run.smithi081.stdout:created 2020-10-05T11:54:36.569367+0000 2020-10-05T11:54:36.569 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 0 (unknown) 2020-10-05T11:54:36.569 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2020-10-05T11:54:36.569 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2020-10-05T11:54:36.569 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c2.monmap (1 monitors) 2020-10-05T11:54:36.570 INFO:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2020-10-05T11:54:36.619 INFO:tasks.ceph:Writing /etc/ceph/c2.conf for FSID 7aabd69d-1bd4-492d-8378-46a0a5b6b398... 2020-10-05T11:54:36.620 INFO:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2020-10-05T11:54:36.663 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2020-10-05T11:54:36.693 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2020-10-05T11:54:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2020-10-05T11:54:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-05T11:54:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2020-10-05T11:54:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2020-10-05T11:54:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2020-10-05T11:54:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2020-10-05T11:54:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2020-10-05T11:54:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2020-10-05T11:54:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2020-10-05T11:54:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-05T11:54:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2020-10-05T11:54:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2020-10-05T11:54:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-05T11:54:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.696 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2020-10-05T11:54:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2020-10-05T11:54:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2020-10-05T11:54:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2020-10-05T11:54:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2020-10-05T11:54:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2020-10-05T11:54:36.697 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2020-10-05T11:54:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2020-10-05T11:54:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-05T11:54:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-05T11:54:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2020-10-05T11:54:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-05T11:54:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2020-10-05T11:54:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2020-10-05T11:54:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2020-10-05T11:54:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2020-10-05T11:54:36.699 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = 172.21.15.81 2020-10-05T11:54:36.700 INFO:teuthology.orchestra.run.smithi081.stdout: osd heartbeat grace = 40 2020-10-05T11:54:36.700 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 7aabd69d-1bd4-492d-8378-46a0a5b6b398 2020-10-05T11:54:36.700 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.700 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2020-10-05T11:54:36.700 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2020-10-05T11:54:36.700 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.700 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2020-10-05T11:54:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2020-10-05T11:54:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2020-10-05T11:54:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2020-10-05T11:54:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2020-10-05T11:54:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2020-10-05T11:54:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2020-10-05T11:54:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2020-10-05T11:54:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2020-10-05T11:54:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2020-10-05T11:54:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2020-10-05T11:54:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2020-10-05T11:54:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2020-10-05T11:54:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2020-10-05T11:54:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2020-10-05T11:54:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2020-10-05T11:54:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: debug filestore = 20 2020-10-05T11:54:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: debug journal = 20 2020-10-05T11:54:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 20 2020-10-05T11:54:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 25 2020-10-05T11:54:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: osd fast shutdown = False 2020-10-05T11:54:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: rocksdb delete range threshold = 0 2020-10-05T11:54:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.705 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2020-10-05T11:54:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2020-10-05T11:54:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2020-10-05T11:54:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2020-10-05T11:54:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2020-10-05T11:54:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2020-10-05T11:54:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2020-10-05T11:54:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2020-10-05T11:54:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.706 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2020-10-05T11:54:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2020-10-05T11:54:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2020-10-05T11:54:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2020-10-05T11:54:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2020-10-05T11:54:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2020-10-05T11:54:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2020-10-05T11:54:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2020-10-05T11:54:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2020-10-05T11:54:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2020-10-05T11:54:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2020-10-05T11:54:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd crush smoke test = False 2020-10-05T11:54:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:36.708 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2020-10-05T11:54:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2020-10-05T11:54:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2020-10-05T11:54:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2020-10-05T11:54:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-05T11:54:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-05T11:54:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: debug rgw = 20 2020-10-05T11:54:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: rgw crypt require ssl = False 2020-10-05T11:54:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: rgw crypt s3 kms backend = testing 2020-10-05T11:54:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2020-10-05T11:54:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: rgw curl low speed time = 300 2020-10-05T11:54:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: rgw data log num shards = 4 2020-10-05T11:54:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: rgw md log max shards = 4 2020-10-05T11:54:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: rgw sync log trim interval = 0 2020-10-05T11:54:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: rgw sync obj etag verify = True 2020-10-05T11:54:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: setgroup = ceph 2020-10-05T11:54:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: setuser = ceph 2020-10-05T11:54:36.711 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2020-10-05T11:54:36.712 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2020-10-05T11:54:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: osd_max_omap_entries_per_request = 10 2020-10-05T11:54:36.712 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2020-10-05T11:54:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: osd_max_omap_entries_per_request = 1000 2020-10-05T11:54:36.713 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2020-10-05T11:54:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: osd_max_omap_entries_per_request = 10000 2020-10-05T11:54:36.715 INFO:teuthology.orchestra.run.smithi158.stdout:[global] 2020-10-05T11:54:36.715 INFO:teuthology.orchestra.run.smithi158.stdout: chdir = "" 2020-10-05T11:54:36.715 INFO:teuthology.orchestra.run.smithi158.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-05T11:54:36.715 INFO:teuthology.orchestra.run.smithi158.stdout: auth supported = cephx 2020-10-05T11:54:36.716 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.716 INFO:teuthology.orchestra.run.smithi158.stdout: filestore xattr use omap = true 2020-10-05T11:54:36.716 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.716 INFO:teuthology.orchestra.run.smithi158.stdout: mon clock drift allowed = 1.000 2020-10-05T11:54:36.717 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.717 INFO:teuthology.orchestra.run.smithi158.stdout: osd crush chooseleaf type = 0 2020-10-05T11:54:36.717 INFO:teuthology.orchestra.run.smithi158.stdout: auth debug = true 2020-10-05T11:54:36.717 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.717 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on old message = true 2020-10-05T11:54:36.718 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on bug = true 2020-10-05T11:54:36.718 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.718 INFO:teuthology.orchestra.run.smithi158.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-05T11:54:36.718 INFO:teuthology.orchestra.run.smithi158.stdout: mon pg warn max object skew = 0 2020-10-05T11:54:36.719 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.719 INFO:teuthology.orchestra.run.smithi158.stdout: # disable pg_autoscaler by default for new pools 2020-10-05T11:54:36.719 INFO:teuthology.orchestra.run.smithi158.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-05T11:54:36.719 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.719 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default size = 2 2020-10-05T11:54:36.719 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.719 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow primary affinity = true 2020-10-05T11:54:36.720 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow pg remap = true 2020-10-05T11:54:36.720 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on legacy crush tunables = false 2020-10-05T11:54:36.720 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on crush straw calc version zero = false 2020-10-05T11:54:36.720 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on no sortbitwise = false 2020-10-05T11:54:36.720 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on osd down out interval zero = false 2020-10-05T11:54:36.720 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on too few osds = false 2020-10-05T11:54:36.720 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-05T11:54:36.721 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-05T11:54:36.721 INFO:teuthology.orchestra.run.smithi158.stdout: mon_allow_pool_size_one = true 2020-10-05T11:54:36.721 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.721 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-05T11:54:36.721 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.721 INFO:teuthology.orchestra.run.smithi158.stdout: osd default data pool replay window = 5 2020-10-05T11:54:36.721 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.722 INFO:teuthology.orchestra.run.smithi158.stdout: mon allow pool delete = true 2020-10-05T11:54:36.722 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.722 INFO:teuthology.orchestra.run.smithi158.stdout: mon cluster log file level = debug 2020-10-05T11:54:36.722 INFO:teuthology.orchestra.run.smithi158.stdout: debug asserts on shutdown = true 2020-10-05T11:54:36.722 INFO:teuthology.orchestra.run.smithi158.stdout: mon host = 172.21.15.81 2020-10-05T11:54:36.722 INFO:teuthology.orchestra.run.smithi158.stdout: osd heartbeat grace = 40 2020-10-05T11:54:36.722 INFO:teuthology.orchestra.run.smithi158.stdout: fsid = 7aabd69d-1bd4-492d-8378-46a0a5b6b398 2020-10-05T11:54:36.722 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.723 INFO:teuthology.orchestra.run.smithi158.stdout:[osd] 2020-10-05T11:54:36.723 INFO:teuthology.orchestra.run.smithi158.stdout: osd journal size = 100 2020-10-05T11:54:36.723 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.723 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub load threshold = 5.0 2020-10-05T11:54:36.723 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub max interval = 600 2020-10-05T11:54:36.723 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.723 INFO:teuthology.orchestra.run.smithi158.stdout: osd recover clone overlap = true 2020-10-05T11:54:36.724 INFO:teuthology.orchestra.run.smithi158.stdout: osd recovery max chunk = 1048576 2020-10-05T11:54:36.724 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.724 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug shutdown = true 2020-10-05T11:54:36.724 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug op order = true 2020-10-05T11:54:36.724 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug verify stray on activate = true 2020-10-05T11:54:36.724 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.724 INFO:teuthology.orchestra.run.smithi158.stdout: osd open classes on start = true 2020-10-05T11:54:36.724 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug pg log writeout = true 2020-10-05T11:54:36.725 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.725 INFO:teuthology.orchestra.run.smithi158.stdout: osd deep scrub update digest min age = 30 2020-10-05T11:54:36.725 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.725 INFO:teuthology.orchestra.run.smithi158.stdout: osd map max advance = 10 2020-10-05T11:54:36.725 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.725 INFO:teuthology.orchestra.run.smithi158.stdout: journal zero on create = true 2020-10-05T11:54:36.725 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.726 INFO:teuthology.orchestra.run.smithi158.stdout: filestore ondisk finisher threads = 3 2020-10-05T11:54:36.726 INFO:teuthology.orchestra.run.smithi158.stdout: filestore apply finisher threads = 3 2020-10-05T11:54:36.726 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.726 INFO:teuthology.orchestra.run.smithi158.stdout: bdev debug aio = true 2020-10-05T11:54:36.726 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug misdirected ops = true 2020-10-05T11:54:36.726 INFO:teuthology.orchestra.run.smithi158.stdout: debug filestore = 20 2020-10-05T11:54:36.726 INFO:teuthology.orchestra.run.smithi158.stdout: debug journal = 20 2020-10-05T11:54:36.727 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 20 2020-10-05T11:54:36.727 INFO:teuthology.orchestra.run.smithi158.stdout: debug osd = 25 2020-10-05T11:54:36.727 INFO:teuthology.orchestra.run.smithi158.stdout: osd fast shutdown = False 2020-10-05T11:54:36.727 INFO:teuthology.orchestra.run.smithi158.stdout: rocksdb delete range threshold = 0 2020-10-05T11:54:36.727 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.727 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr] 2020-10-05T11:54:36.727 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2020-10-05T11:54:36.727 INFO:teuthology.orchestra.run.smithi158.stdout: debug mgr = 20 2020-10-05T11:54:36.728 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2020-10-05T11:54:36.728 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2020-10-05T11:54:36.728 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2020-10-05T11:54:36.728 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2020-10-05T11:54:36.728 INFO:teuthology.orchestra.run.smithi158.stdout: mgr/telemetry/nag = false 2020-10-05T11:54:36.728 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.728 INFO:teuthology.orchestra.run.smithi158.stdout:[mon] 2020-10-05T11:54:36.729 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2020-10-05T11:54:36.729 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2020-10-05T11:54:36.729 INFO:teuthology.orchestra.run.smithi158.stdout: debug paxos = 20 2020-10-05T11:54:36.729 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2020-10-05T11:54:36.729 INFO:teuthology.orchestra.run.smithi158.stdout: mon data avail warn = 5 2020-10-05T11:54:36.729 INFO:teuthology.orchestra.run.smithi158.stdout: mon mgr mkfs grace = 240 2020-10-05T11:54:36.729 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2020-10-05T11:54:36.729 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd reporter subtree level = osd 2020-10-05T11:54:36.730 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd prime pg temp = true 2020-10-05T11:54:36.730 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2020-10-05T11:54:36.730 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd crush smoke test = False 2020-10-05T11:54:36.730 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:54:36.730 INFO:teuthology.orchestra.run.smithi158.stdout:[client] 2020-10-05T11:54:36.730 INFO:teuthology.orchestra.run.smithi158.stdout: rgw cache enabled = true 2020-10-05T11:54:36.730 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable ops log = true 2020-10-05T11:54:36.731 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable usage log = true 2020-10-05T11:54:36.731 INFO:teuthology.orchestra.run.smithi158.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-05T11:54:36.731 INFO:teuthology.orchestra.run.smithi158.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-05T11:54:36.731 INFO:teuthology.orchestra.run.smithi158.stdout: debug rgw = 20 2020-10-05T11:54:36.731 INFO:teuthology.orchestra.run.smithi158.stdout: rgw crypt require ssl = False 2020-10-05T11:54:36.731 INFO:teuthology.orchestra.run.smithi158.stdout: rgw crypt s3 kms backend = testing 2020-10-05T11:54:36.731 INFO:teuthology.orchestra.run.smithi158.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2020-10-05T11:54:36.731 INFO:teuthology.orchestra.run.smithi158.stdout: rgw curl low speed time = 300 2020-10-05T11:54:36.732 INFO:teuthology.orchestra.run.smithi158.stdout: rgw data log num shards = 4 2020-10-05T11:54:36.732 INFO:teuthology.orchestra.run.smithi158.stdout: rgw md log max shards = 4 2020-10-05T11:54:36.732 INFO:teuthology.orchestra.run.smithi158.stdout: rgw sync log trim interval = 0 2020-10-05T11:54:36.732 INFO:teuthology.orchestra.run.smithi158.stdout: rgw sync obj etag verify = True 2020-10-05T11:54:36.732 INFO:teuthology.orchestra.run.smithi158.stdout: setgroup = ceph 2020-10-05T11:54:36.732 INFO:teuthology.orchestra.run.smithi158.stdout: setuser = ceph 2020-10-05T11:54:36.732 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.a] 2020-10-05T11:54:36.733 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.0] 2020-10-05T11:54:36.733 INFO:teuthology.orchestra.run.smithi158.stdout: osd_max_omap_entries_per_request = 10 2020-10-05T11:54:36.733 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.1] 2020-10-05T11:54:36.733 INFO:teuthology.orchestra.run.smithi158.stdout: osd_max_omap_entries_per_request = 1000 2020-10-05T11:54:36.733 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.2] 2020-10-05T11:54:36.733 INFO:teuthology.orchestra.run.smithi158.stdout: osd_max_omap_entries_per_request = 10000 2020-10-05T11:54:36.734 INFO:tasks.ceph:Creating admin key on c2.mon.a... 2020-10-05T11:54:36.734 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c2.keyring 2020-10-05T11:54:36.802 INFO:tasks.ceph:Copying monmap to all nodes... 2020-10-05T11:54:36.802 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:36.803 INFO:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/c2.keyring of=/dev/stdout 2020-10-05T11:54:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:+ dd if=/etc/ceph/c2.keyring of=/dev/stdout 2020-10-05T11:54:36.851 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.] 2020-10-05T11:54:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB8CXtf7BAKFxAA8JLZXSlIALvxg5h4ZIMySw== 2020-10-05T11:54:36.852 INFO:teuthology.orchestra.run.smithi081.stdout:[client.admin] 2020-10-05T11:54:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB8CXtfkXPWLxAA80x0pgd4Gq16UJou1kfqDg== 2020-10-05T11:54:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow *" 2020-10-05T11:54:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: caps mgr = "allow *" 2020-10-05T11:54:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow *" 2020-10-05T11:54:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow *" 2020-10-05T11:54:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:206 bytes copied, 0.000171457 s, 1.2 MB/s 2020-10-05T11:54:36.853 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:36.854 INFO:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/c2.monmap of=/dev/stdout 2020-10-05T11:54:36.902 INFO:teuthology.orchestra.run.smithi081.stderr:+ dd if=/home/ubuntu/cephtest/c2.monmap of=/dev/stdout 2020-10-05T11:54:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: �z�֝�I-�xF�����| {_j��!| {_j��!�aXa �Q��Qa 2020-10-05T11:54:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:201 bytes copied, 0.000171827 s, 1.2 MB/s 2020-10-05T11:54:36.904 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi158.front.sepia.ceph.com 2020-10-05T11:54:36.904 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:36.905 INFO:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/ceph/c2.keyring 2020-10-05T11:54:36.905 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0644 /etc/ceph/c2.keyring 2020-10-05T11:54:36.910 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo dd of=/etc/ceph/c2.keyring 2020-10-05T11:54:36.919 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:36.919 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:36.919 INFO:teuthology.orchestra.run.smithi158.stderr:206 bytes copied, 6.9777e-05 s, 3.0 MB/s 2020-10-05T11:54:36.920 INFO:teuthology.orchestra.run.smithi158.stderr:+ sudo chmod 0644 /etc/ceph/c2.keyring 2020-10-05T11:54:36.929 INFO:teuthology.orchestra.run.smithi158:> set -ex 2020-10-05T11:54:36.929 INFO:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/c2.monmap 2020-10-05T11:54:36.976 INFO:teuthology.orchestra.run.smithi158.stderr:+ dd of=/home/ubuntu/cephtest/c2.monmap 2020-10-05T11:54:36.977 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2020-10-05T11:54:36.978 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2020-10-05T11:54:36.978 INFO:teuthology.orchestra.run.smithi158.stderr:201 bytes copied, 6.9937e-05 s, 2.9 MB/s 2020-10-05T11:54:36.978 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2020-10-05T11:54:36.978 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:36.979 INFO:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/c2.keyring 2020-10-05T11:54:36.979 INFO:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/c2.keyring 2020-10-05T11:54:36.983 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo dd of=/etc/ceph/c2.keyring 2020-10-05T11:54:36.993 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:36.993 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:36.993 INFO:teuthology.orchestra.run.smithi081.stderr:206 bytes copied, 0.00012504 s, 1.6 MB/s 2020-10-05T11:54:36.994 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo chmod 0644 /etc/ceph/c2.keyring 2020-10-05T11:54:37.002 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:37.003 INFO:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/c2.monmap 2020-10-05T11:54:37.050 INFO:teuthology.orchestra.run.smithi081.stderr:+ dd of=/home/ubuntu/cephtest/c2.monmap 2020-10-05T11:54:37.051 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:37.052 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:37.052 INFO:teuthology.orchestra.run.smithi081.stderr:201 bytes copied, 0.000136797 s, 1.5 MB/s 2020-10-05T11:54:37.052 INFO:tasks.ceph:Setting up mon nodes... 2020-10-05T11:54:37.052 INFO:tasks.ceph:Setting up mgr nodes... 2020-10-05T11:54:37.053 INFO:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/c2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c2-x/keyring 2020-10-05T11:54:37.133 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/c2-x/keyring 2020-10-05T11:54:37.135 INFO:tasks.ceph:Setting up mds nodes... 2020-10-05T11:54:37.136 INFO:tasks.ceph_client:Setting up client nodes... 2020-10-05T11:54:37.136 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c2.client.0.keyring && sudo chmod 0644 /etc/ceph/c2.client.0.keyring 2020-10-05T11:54:37.210 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/c2.client.0.keyring 2020-10-05T11:54:37.221 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c2.client.1.keyring && sudo chmod 0644 /etc/ceph/c2.client.1.keyring 2020-10-05T11:54:37.294 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/c2.client.1.keyring 2020-10-05T11:54:37.306 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-10-05T11:54:37.306 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi158.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2020-10-05T11:54:37.306 INFO:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/c2-0 2020-10-05T11:54:37.365 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2020-10-05T11:54:37.365 INFO:tasks.ceph:role: c2.osd.0 2020-10-05T11:54:37.365 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2020-10-05T11:54:37.366 INFO:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-10-05T11:54:37.889 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-10-05T11:54:37.890 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2020-10-05T11:54:37.890 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-10-05T11:54:37.890 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-10-05T11:54:37.890 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2020-10-05T11:54:37.891 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-10-05T11:54:37.891 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-10-05T11:54:37.891 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-10-05T11:54:37.891 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-10-05T11:54:37.892 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2020-10-05T11:54:37.892 INFO:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c2-0 2020-10-05T11:54:37.979 INFO:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-0 2020-10-05T11:54:37.987 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2020-10-05T11:54:37.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-05T11:54:37.988 INFO:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/c2-1 2020-10-05T11:54:38.049 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2020-10-05T11:54:38.049 INFO:tasks.ceph:role: c2.osd.1 2020-10-05T11:54:38.049 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2020-10-05T11:54:38.050 INFO:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-10-05T11:54:38.582 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-10-05T11:54:38.582 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2020-10-05T11:54:38.582 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-10-05T11:54:38.583 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-10-05T11:54:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2020-10-05T11:54:38.583 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-10-05T11:54:38.583 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-10-05T11:54:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-10-05T11:54:38.583 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-10-05T11:54:38.584 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2020-10-05T11:54:38.584 INFO:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c2-1 2020-10-05T11:54:38.629 INFO:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-1 2020-10-05T11:54:38.680 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2020-10-05T11:54:38.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-05T11:54:38.681 INFO:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/c2-2 2020-10-05T11:54:38.736 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2020-10-05T11:54:38.737 INFO:tasks.ceph:role: c2.osd.2 2020-10-05T11:54:38.737 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2020-10-05T11:54:38.737 INFO:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-10-05T11:54:39.253 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-10-05T11:54:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2020-10-05T11:54:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-10-05T11:54:39.254 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-10-05T11:54:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2020-10-05T11:54:39.254 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-10-05T11:54:39.254 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-10-05T11:54:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-10-05T11:54:39.255 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-10-05T11:54:39.255 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2020-10-05T11:54:39.256 INFO:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c2-2 2020-10-05T11:54:39.309 INFO:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-2 2020-10-05T11:54:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2020-10-05T11:54:39.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-05T11:54:39.320 INFO:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c2.monmap 2020-10-05T11:54:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:39.412+0000 7ffb0bd43d80 -1 auth: error reading file: /var/lib/ceph/osd/c2-0/keyring: can't open /var/lib/ceph/osd/c2-0/keyring: (2) No such file or directory 2020-10-05T11:54:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:39.412+0000 7ffb0bd43d80 -1 created new key in keyring /var/lib/ceph/osd/c2-0/keyring 2020-10-05T11:54:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:39.412+0000 7ffb0bd43d80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2020-10-05T11:54:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:39.412+0000 7ffb0bd43d80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2020-10-05T11:54:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:39.412+0000 7ffb0bd43d80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2020-10-05T11:54:39.416 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:39.416+0000 7ffb0bd43d80 -1 bluestore(/var/lib/ceph/osd/c2-0) _read_fsid unparsable uuid 2020-10-05T11:54:41.578 INFO:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-0 2020-10-05T11:54:41.593 INFO:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c2.monmap 2020-10-05T11:54:41.674 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:41.672+0000 7fe7f8fe6d80 -1 auth: error reading file: /var/lib/ceph/osd/c2-1/keyring: can't open /var/lib/ceph/osd/c2-1/keyring: (2) No such file or directory 2020-10-05T11:54:41.674 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:41.672+0000 7fe7f8fe6d80 -1 created new key in keyring /var/lib/ceph/osd/c2-1/keyring 2020-10-05T11:54:41.674 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:41.672+0000 7fe7f8fe6d80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2020-10-05T11:54:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:41.672+0000 7fe7f8fe6d80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2020-10-05T11:54:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:41.672+0000 7fe7f8fe6d80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2020-10-05T11:54:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:41.676+0000 7fe7f8fe6d80 -1 bluestore(/var/lib/ceph/osd/c2-1) _read_fsid unparsable uuid 2020-10-05T11:54:43.861 INFO:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-1 2020-10-05T11:54:43.917 INFO:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c2.monmap 2020-10-05T11:54:43.995 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:43.996+0000 7ff680975d80 -1 auth: error reading file: /var/lib/ceph/osd/c2-2/keyring: can't open /var/lib/ceph/osd/c2-2/keyring: (2) No such file or directory 2020-10-05T11:54:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:43.996+0000 7ff680975d80 -1 created new key in keyring /var/lib/ceph/osd/c2-2/keyring 2020-10-05T11:54:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:43.996+0000 7ff680975d80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2020-10-05T11:54:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:43.996+0000 7ff680975d80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2020-10-05T11:54:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:43.996+0000 7ff680975d80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2020-10-05T11:54:43.997 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:54:43.996+0000 7ff680975d80 -1 bluestore(/var/lib/ceph/osd/c2-2) _read_fsid unparsable uuid 2020-10-05T11:54:46.177 INFO:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-2 2020-10-05T11:54:46.232 INFO:tasks.ceph:Reading keys from all nodes... 2020-10-05T11:54:46.233 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:46.233 INFO:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/c2-x/keyring of=/dev/stdout 2020-10-05T11:54:46.278 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo dd if=/var/lib/ceph/mgr/c2-x/keyring of=/dev/stdout 2020-10-05T11:54:46.286 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2020-10-05T11:54:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB9CXtfZBoXCBAAzH8tTgHsQh5fcIgQW0G1Jg== 2020-10-05T11:54:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:56 bytes copied, 0.00017829 s, 314 kB/s 2020-10-05T11:54:46.288 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:46.288 INFO:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/c2-0/keyring of=/dev/stdout 2020-10-05T11:54:46.334 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo dd if=/var/lib/ceph/osd/c2-0/keyring of=/dev/stdout 2020-10-05T11:54:46.342 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2020-10-05T11:54:46.342 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB/CXtf9EazGBAAGAS2bYRl0mXU/3Evj0vlPw== 2020-10-05T11:54:46.343 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:46.343 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:46.343 INFO:teuthology.orchestra.run.smithi081.stderr:56 bytes copied, 0.000201163 s, 278 kB/s 2020-10-05T11:54:46.344 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:46.344 INFO:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/c2-1/keyring of=/dev/stdout 2020-10-05T11:54:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo dd if=/var/lib/ceph/osd/c2-1/keyring of=/dev/stdout 2020-10-05T11:54:46.398 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2020-10-05T11:54:46.399 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCBCXtf5dhLKBAAdPY7c2GA3s5EDEhEYfgE6g== 2020-10-05T11:54:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:56 bytes copied, 0.000159864 s, 350 kB/s 2020-10-05T11:54:46.400 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:46.400 INFO:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/c2-2/keyring of=/dev/stdout 2020-10-05T11:54:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo dd if=/var/lib/ceph/osd/c2-2/keyring of=/dev/stdout 2020-10-05T11:54:46.454 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2020-10-05T11:54:46.455 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCDCXtfOlF3OxAApt35eIzPpvzVtpZfevQNlA== 2020-10-05T11:54:46.455 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:46.455 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:46.455 INFO:teuthology.orchestra.run.smithi081.stderr:56 bytes copied, 0.000170284 s, 329 kB/s 2020-10-05T11:54:46.456 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:46.456 INFO:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/c2.client.0.keyring of=/dev/stdout 2020-10-05T11:54:46.505 INFO:teuthology.orchestra.run.smithi081.stderr:+ dd if=/etc/ceph/c2.client.0.keyring of=/dev/stdout 2020-10-05T11:54:46.507 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2020-10-05T11:54:46.507 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB9CXtfbAirDBAA4bQjgY9mU+mvL7OkYH5vVA== 2020-10-05T11:54:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:46.507 INFO:teuthology.orchestra.run.smithi081.stderr:59 bytes copied, 0.000147035 s, 401 kB/s 2020-10-05T11:54:46.508 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:46.508 INFO:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/c2.client.1.keyring of=/dev/stdout 2020-10-05T11:54:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:+ dd if=/etc/ceph/c2.client.1.keyring of=/dev/stdout 2020-10-05T11:54:46.555 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2020-10-05T11:54:46.555 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB9CXtfLSewERAAYNswcyC5A60+0yeDBlQ0OA== 2020-10-05T11:54:46.555 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:46.555 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:46.555 INFO:teuthology.orchestra.run.smithi081.stderr:59 bytes copied, 0.000169707 s, 348 kB/s 2020-10-05T11:54:46.556 INFO:tasks.ceph:Adding keys to all mons... 2020-10-05T11:54:46.556 INFO:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/c2.keyring 2020-10-05T11:54:46.610 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2020-10-05T11:54:46.610 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB9CXtfZBoXCBAAzH8tTgHsQh5fcIgQW0G1Jg== 2020-10-05T11:54:46.611 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2020-10-05T11:54:46.611 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB/CXtf9EazGBAAGAS2bYRl0mXU/3Evj0vlPw== 2020-10-05T11:54:46.611 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2020-10-05T11:54:46.611 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCBCXtf5dhLKBAAdPY7c2GA3s5EDEhEYfgE6g== 2020-10-05T11:54:46.611 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2020-10-05T11:54:46.611 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCDCXtfOlF3OxAApt35eIzPpvzVtpZfevQNlA== 2020-10-05T11:54:46.611 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2020-10-05T11:54:46.612 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB9CXtfbAirDBAA4bQjgY9mU+mvL7OkYH5vVA== 2020-10-05T11:54:46.612 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2020-10-05T11:54:46.612 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB9CXtfLSewERAAYNswcyC5A60+0yeDBlQ0OA== 2020-10-05T11:54:46.613 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-10-05T11:54:46.695 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-05T11:54:46.779 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-05T11:54:46.863 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-05T11:54:46.945 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-10-05T11:54:47.029 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-10-05T11:54:47.113 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-10-05T11:54:47.114 INFO:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/c2-a 2020-10-05T11:54:47.172 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c2 --mkfs -i a --monmap /home/ubuntu/cephtest/c2.monmap --keyring /etc/ceph/c2.keyring 2020-10-05T11:54:47.268 INFO:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c2-a 2020-10-05T11:54:47.281 INFO:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/c2.monmap 2020-10-05T11:54:47.327 INFO:tasks.ceph:Starting mon daemons in cluster c2... 2020-10-05T11:54:47.328 INFO:tasks.ceph.c2.mon.a:Restarting daemon 2020-10-05T11:54:47.328 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c2 -i a 2020-10-05T11:54:47.371 INFO:tasks.ceph.c2.mon.a:Started 2020-10-05T11:54:47.372 INFO:tasks.ceph:Starting mgr daemons in cluster c2... 2020-10-05T11:54:47.372 INFO:tasks.ceph.c2.mgr.x:Restarting daemon 2020-10-05T11:54:47.372 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c2 -i x 2020-10-05T11:54:47.374 INFO:tasks.ceph.c2.mgr.x:Started 2020-10-05T11:54:47.375 INFO:tasks.ceph:Setting crush tunables to default 2020-10-05T11:54:47.375 INFO:teuthology.orchestra.run.smithi081:> sudo ceph --cluster c2 osd crush tunables default 2020-10-05T11:54:47.817 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2020-10-05T11:54:47.827 INFO:tasks.ceph:Starting osd daemons in cluster c2... 2020-10-05T11:54:47.827 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:47.827 INFO:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/c2-0/fsid of=/dev/stdout 2020-10-05T11:54:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo dd if=/var/lib/ceph/osd/c2-0/fsid of=/dev/stdout 2020-10-05T11:54:47.835 INFO:teuthology.orchestra.run.smithi081.stdout:6f44d9b2-4170-4016-a3f2-bf53c6e21c94 2020-10-05T11:54:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:37 bytes copied, 0.000136874 s, 270 kB/s 2020-10-05T11:54:47.836 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:47.836 INFO:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/c2-1/fsid of=/dev/stdout 2020-10-05T11:54:47.885 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo dd if=/var/lib/ceph/osd/c2-1/fsid of=/dev/stdout 2020-10-05T11:54:47.893 INFO:teuthology.orchestra.run.smithi081.stdout:9fe68002-b6cd-4700-b1b6-7c71d191be38 2020-10-05T11:54:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:47.894 INFO:teuthology.orchestra.run.smithi081.stderr:37 bytes copied, 0.000169448 s, 218 kB/s 2020-10-05T11:54:47.895 INFO:teuthology.orchestra.run.smithi081:> set -ex 2020-10-05T11:54:47.895 INFO:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/c2-2/fsid of=/dev/stdout 2020-10-05T11:54:47.941 INFO:teuthology.orchestra.run.smithi081.stderr:+ sudo dd if=/var/lib/ceph/osd/c2-2/fsid of=/dev/stdout 2020-10-05T11:54:47.949 INFO:teuthology.orchestra.run.smithi081.stdout:8a8db8d3-5616-4f25-ac2e-4ae9d497d3ac 2020-10-05T11:54:47.950 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2020-10-05T11:54:47.950 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2020-10-05T11:54:47.950 INFO:teuthology.orchestra.run.smithi081.stderr:37 bytes copied, 0.000221073 s, 167 kB/s 2020-10-05T11:54:47.951 INFO:teuthology.orchestra.run.smithi081:> sudo ceph --cluster c2 osd new 6f44d9b2-4170-4016-a3f2-bf53c6e21c94 0 2020-10-05T11:54:48.208 INFO:teuthology.orchestra.run.smithi081.stdout:0 2020-10-05T11:54:48.221 INFO:teuthology.orchestra.run.smithi081:> sudo ceph --cluster c2 osd new 9fe68002-b6cd-4700-b1b6-7c71d191be38 1 2020-10-05T11:54:48.443 INFO:teuthology.orchestra.run.smithi081.stdout:1 2020-10-05T11:54:48.456 INFO:teuthology.orchestra.run.smithi081:> sudo ceph --cluster c2 osd new 8a8db8d3-5616-4f25-ac2e-4ae9d497d3ac 2 2020-10-05T11:54:48.665 INFO:teuthology.orchestra.run.smithi081.stdout:2 2020-10-05T11:54:48.677 INFO:tasks.ceph.c2.osd.0:Restarting daemon 2020-10-05T11:54:48.678 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 0 2020-10-05T11:54:48.680 INFO:tasks.ceph.c2.osd.0:Started 2020-10-05T11:54:48.680 INFO:tasks.ceph.c2.osd.1:Restarting daemon 2020-10-05T11:54:48.681 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 1 2020-10-05T11:54:48.683 INFO:tasks.ceph.c2.osd.1:Started 2020-10-05T11:54:48.683 INFO:tasks.ceph.c2.osd.2:Restarting daemon 2020-10-05T11:54:48.683 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 2 2020-10-05T11:54:48.685 INFO:tasks.ceph.c2.osd.2:Started 2020-10-05T11:54:48.685 INFO:tasks.ceph:Waiting for OSDs to come up 2020-10-05T11:54:48.988 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2020-10-05T11:54:49.043 INFO:tasks.ceph.c2.osd.1.smithi081.stderr:2020-10-05T11:54:49.044+0000 7fe862b21d80 -1 Falling back to public interface 2020-10-05T11:54:49.178 INFO:teuthology.misc.health.smithi081.stdout: 2020-10-05T11:54:49.178 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":5,"fsid":"7aabd69d-1bd4-492d-8378-46a0a5b6b398","created":"2020-10-05T11:54:47.511243+0000","modified":"2020-10-05T11:54:48.664247+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"6f44d9b2-4170-4016-a3f2-bf53c6e21c94","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9fe68002-b6cd-4700-b1b6-7c71d191be38","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8a8db8d3-5616-4f25-ac2e-4ae9d497d3ac","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-10-05T11:54:49.189 DEBUG:teuthology.misc:0 of 3 OSDs are up 2020-10-05T11:54:49.295 INFO:tasks.ceph.c2.osd.0.smithi081.stderr:2020-10-05T11:54:49.296+0000 7fcd10785d80 -1 Falling back to public interface 2020-10-05T11:54:49.307 INFO:tasks.ceph.c2.osd.2.smithi081.stderr:2020-10-05T11:54:49.308+0000 7f97e1e67d80 -1 Falling back to public interface 2020-10-05T11:54:49.657 INFO:tasks.ceph.c2.osd.1.smithi081.stderr:2020-10-05T11:54:49.656+0000 7fe862b21d80 -1 osd.1 0 log_to_monitors {default=true} 2020-10-05T11:54:49.900 INFO:tasks.ceph.c2.osd.0.smithi081.stderr:2020-10-05T11:54:49.900+0000 7fcd10785d80 -1 osd.0 0 log_to_monitors {default=true} 2020-10-05T11:54:49.936 INFO:tasks.ceph.c2.osd.2.smithi081.stderr:2020-10-05T11:54:49.936+0000 7f97e1e67d80 -1 osd.2 0 log_to_monitors {default=true} 2020-10-05T11:54:51.540 INFO:tasks.ceph.c2.osd.1.smithi081.stderr:2020-10-05T11:54:51.540+0000 7fe859fec700 -1 osd.1 0 waiting for initial osdmap 2020-10-05T11:54:51.541 INFO:tasks.ceph.c2.osd.2.smithi081.stderr:2020-10-05T11:54:51.540+0000 7f97d9332700 -1 osd.2 0 waiting for initial osdmap 2020-10-05T11:54:51.541 INFO:tasks.ceph.c2.osd.0.smithi081.stderr:2020-10-05T11:54:51.540+0000 7fcd07c50700 -1 osd.0 0 waiting for initial osdmap 2020-10-05T11:54:55.493 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2020-10-05T11:54:55.775 INFO:teuthology.misc.health.smithi081.stdout: 2020-10-05T11:54:55.775 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"7aabd69d-1bd4-492d-8378-46a0a5b6b398","created":"2020-10-05T11:54:47.511243+0000","modified":"2020-10-05T11:54:54.562820+0000","last_up_change":"2020-10-05T11:54:52.537995+0000","last_in_change":"2020-10-05T11:54:52.537995+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-05T11:54:51.359082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"6f44d9b2-4170-4016-a3f2-bf53c6e21c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":12192},{"type":"v1","addr":"172.21.15.81:6809","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":12192},{"type":"v1","addr":"172.21.15.81:6811","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":12192},{"type":"v1","addr":"172.21.15.81:6815","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":12192},{"type":"v1","addr":"172.21.15.81:6813","nonce":12192}]},"public_addr":"172.21.15.81:6809/12192","cluster_addr":"172.21.15.81:6811/12192","heartbeat_back_addr":"172.21.15.81:6815/12192","heartbeat_front_addr":"172.21.15.81:6813/12192","state":["exists","up"]},{"osd":1,"uuid":"9fe68002-b6cd-4700-b1b6-7c71d191be38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":12190},{"type":"v1","addr":"172.21.15.81:6801","nonce":12190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":12190},{"type":"v1","addr":"172.21.15.81:6803","nonce":12190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":12190},{"type":"v1","addr":"172.21.15.81:6807","nonce":12190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":12190},{"type":"v1","addr":"172.21.15.81:6805","nonce":12190}]},"public_addr":"172.21.15.81:6801/12190","cluster_addr":"172.21.15.81:6803/12190","heartbeat_back_addr":"172.21.15.81:6807/12190","heartbeat_front_addr":"172.21.15.81:6805/12190","state":["exists","up"]},{"osd":2,"uuid":"8a8db8d3-5616-4f25-ac2e-4ae9d497d3ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":12193},{"type":"v1","addr":"172.21.15.81:6817","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":12193},{"type":"v1","addr":"172.21.15.81:6819","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":12193},{"type":"v1","addr":"172.21.15.81:6823","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":12193},{"type":"v1","addr":"172.21.15.81:6821","nonce":12193}]},"public_addr":"172.21.15.81:6817/12193","cluster_addr":"172.21.15.81:6819/12193","heartbeat_back_addr":"172.21.15.81:6823/12193","heartbeat_front_addr":"172.21.15.81:6821/12193","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:50.879921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:50.648740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:50.971513+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-10-05T11:54:55.788 DEBUG:teuthology.misc:3 of 3 OSDs are up 2020-10-05T11:54:55.788 INFO:tasks.ceph:Creating RBD pool 2020-10-05T11:54:55.788 INFO:teuthology.orchestra.run.smithi081:> sudo ceph --cluster c2 osd pool create rbd 8 2020-10-05T11:54:56.596 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'rbd' created 2020-10-05T11:54:56.609 INFO:teuthology.orchestra.run.smithi081:> sudo ceph --cluster c2 osd pool application enable rbd rbd --yes-i-really-mean-it 2020-10-05T11:54:57.608 INFO:teuthology.orchestra.run.smithi081.stderr:enabled application 'rbd' on pool 'rbd' 2020-10-05T11:54:57.621 INFO:tasks.ceph:Starting mds daemons in cluster c2... 2020-10-05T11:54:57.622 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early osd dump --format=json 2020-10-05T11:54:57.623 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-10-05T11:54:57.901 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:57.901 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"fsid":"7aabd69d-1bd4-492d-8378-46a0a5b6b398","created":"2020-10-05T11:54:47.511243+0000","modified":"2020-10-05T11:54:57.585237+0000","last_up_change":"2020-10-05T11:54:52.537995+0000","last_in_change":"2020-10-05T11:54:52.537995+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-05T11:54:51.359082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-05T11:54:56.078850+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"6f44d9b2-4170-4016-a3f2-bf53c6e21c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":12192},{"type":"v1","addr":"172.21.15.81:6809","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":12192},{"type":"v1","addr":"172.21.15.81:6811","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":12192},{"type":"v1","addr":"172.21.15.81:6815","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":12192},{"type":"v1","addr":"172.21.15.81:6813","nonce":12192}]},"public_addr":"172.21.15.81:6809/12192","cluster_addr":"172.21.15.81:6811/12192","heartbeat_back_addr":"172.21.15.81:6815/12192","heartbeat_front_addr":"172.21.15.81:6813/12192","state":["exists","up"]},{"osd":1,"uuid":"9fe68002-b6cd-4700-b1b6-7c71d191be38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":12190},{"type":"v1","addr":"172.21.15.81:6801","nonce":12190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":12190},{"type":"v1","addr":"172.21.15.81:6803","nonce":12190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":12190},{"type":"v1","addr":"172.21.15.81:6807","nonce":12190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":12190},{"type":"v1","addr":"172.21.15.81:6805","nonce":12190}]},"public_addr":"172.21.15.81:6801/12190","cluster_addr":"172.21.15.81:6803/12190","heartbeat_back_addr":"172.21.15.81:6807/12190","heartbeat_front_addr":"172.21.15.81:6805/12190","state":["exists","up"]},{"osd":2,"uuid":"8a8db8d3-5616-4f25-ac2e-4ae9d497d3ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":12193},{"type":"v1","addr":"172.21.15.81:6817","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":12193},{"type":"v1","addr":"172.21.15.81:6819","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":12193},{"type":"v1","addr":"172.21.15.81:6823","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":12193},{"type":"v1","addr":"172.21.15.81:6821","nonce":12193}]},"public_addr":"172.21.15.81:6817/12193","cluster_addr":"172.21.15.81:6819/12193","heartbeat_back_addr":"172.21.15.81:6823/12193","heartbeat_front_addr":"172.21.15.81:6821/12193","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:50.879921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:50.648740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:50.971513+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-10-05T11:54:57.915 INFO:tasks.ceph.ceph_manager.c2:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-05T11:54:51.359082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-05T11:54:56.078850+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-05T11:54:57.915 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early osd pool get device_health_metrics pg_num 2020-10-05T11:54:58.204 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2020-10-05T11:54:58.217 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early osd pool get rbd pg_num 2020-10-05T11:54:58.505 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2020-10-05T11:54:58.519 INFO:tasks.ceph:Waiting until c2 daemons up and pgs clean... 2020-10-05T11:54:58.520 INFO:tasks.ceph.ceph_manager.c2:waiting for mgr available 2020-10-05T11:54:58.520 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early mgr dump --format=json 2020-10-05T11:54:58.838 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:58.851 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":4,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":12007},{"type":"v1","addr":"172.21.15.81:6825","nonce":12007}]},"active_addr":"172.21.15.81:6825/12007","active_change":"2020-10-05T11:54:51.334084+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2493919254}]},{"addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":282746469}]},{"addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":754759441}]}]}} 2020-10-05T11:54:58.856 INFO:tasks.ceph.ceph_manager.c2:mgr available! 2020-10-05T11:54:58.856 INFO:tasks.ceph.ceph_manager.c2:waiting for all up 2020-10-05T11:54:58.857 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early osd dump --format=json 2020-10-05T11:54:59.145 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:59.145 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":13,"fsid":"7aabd69d-1bd4-492d-8378-46a0a5b6b398","created":"2020-10-05T11:54:47.511243+0000","modified":"2020-10-05T11:54:58.592058+0000","last_up_change":"2020-10-05T11:54:52.537995+0000","last_in_change":"2020-10-05T11:54:52.537995+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-05T11:54:51.359082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-05T11:54:56.078850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"6f44d9b2-4170-4016-a3f2-bf53c6e21c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":12192},{"type":"v1","addr":"172.21.15.81:6809","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":12192},{"type":"v1","addr":"172.21.15.81:6811","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":12192},{"type":"v1","addr":"172.21.15.81:6815","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":12192},{"type":"v1","addr":"172.21.15.81:6813","nonce":12192}]},"public_addr":"172.21.15.81:6809/12192","cluster_addr":"172.21.15.81:6811/12192","heartbeat_back_addr":"172.21.15.81:6815/12192","heartbeat_front_addr":"172.21.15.81:6813/12192","state":["exists","up"]},{"osd":1,"uuid":"9fe68002-b6cd-4700-b1b6-7c71d191be38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":12190},{"type":"v1","addr":"172.21.15.81:6801","nonce":12190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":12190},{"type":"v1","addr":"172.21.15.81:6803","nonce":12190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":12190},{"type":"v1","addr":"172.21.15.81:6807","nonce":12190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":12190},{"type":"v1","addr":"172.21.15.81:6805","nonce":12190}]},"public_addr":"172.21.15.81:6801/12190","cluster_addr":"172.21.15.81:6803/12190","heartbeat_back_addr":"172.21.15.81:6807/12190","heartbeat_front_addr":"172.21.15.81:6805/12190","state":["exists","up"]},{"osd":2,"uuid":"8a8db8d3-5616-4f25-ac2e-4ae9d497d3ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":12193},{"type":"v1","addr":"172.21.15.81:6817","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":12193},{"type":"v1","addr":"172.21.15.81:6819","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":12193},{"type":"v1","addr":"172.21.15.81:6823","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":12193},{"type":"v1","addr":"172.21.15.81:6821","nonce":12193}]},"public_addr":"172.21.15.81:6817/12193","cluster_addr":"172.21.15.81:6819/12193","heartbeat_back_addr":"172.21.15.81:6823/12193","heartbeat_front_addr":"172.21.15.81:6821/12193","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:50.879921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:50.648740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:50.971513+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-10-05T11:54:59.158 INFO:tasks.ceph.ceph_manager.c2:all up! 2020-10-05T11:54:59.159 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early osd dump --format=json 2020-10-05T11:54:59.448 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:54:59.448 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":13,"fsid":"7aabd69d-1bd4-492d-8378-46a0a5b6b398","created":"2020-10-05T11:54:47.511243+0000","modified":"2020-10-05T11:54:58.592058+0000","last_up_change":"2020-10-05T11:54:52.537995+0000","last_in_change":"2020-10-05T11:54:52.537995+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-05T11:54:51.359082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-05T11:54:56.078850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"6f44d9b2-4170-4016-a3f2-bf53c6e21c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":12192},{"type":"v1","addr":"172.21.15.81:6809","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":12192},{"type":"v1","addr":"172.21.15.81:6811","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":12192},{"type":"v1","addr":"172.21.15.81:6815","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":12192},{"type":"v1","addr":"172.21.15.81:6813","nonce":12192}]},"public_addr":"172.21.15.81:6809/12192","cluster_addr":"172.21.15.81:6811/12192","heartbeat_back_addr":"172.21.15.81:6815/12192","heartbeat_front_addr":"172.21.15.81:6813/12192","state":["exists","up"]},{"osd":1,"uuid":"9fe68002-b6cd-4700-b1b6-7c71d191be38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":12190},{"type":"v1","addr":"172.21.15.81:6801","nonce":12190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":12190},{"type":"v1","addr":"172.21.15.81:6803","nonce":12190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":12190},{"type":"v1","addr":"172.21.15.81:6807","nonce":12190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":12190},{"type":"v1","addr":"172.21.15.81:6805","nonce":12190}]},"public_addr":"172.21.15.81:6801/12190","cluster_addr":"172.21.15.81:6803/12190","heartbeat_back_addr":"172.21.15.81:6807/12190","heartbeat_front_addr":"172.21.15.81:6805/12190","state":["exists","up"]},{"osd":2,"uuid":"8a8db8d3-5616-4f25-ac2e-4ae9d497d3ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":12193},{"type":"v1","addr":"172.21.15.81:6817","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":12193},{"type":"v1","addr":"172.21.15.81:6819","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":12193},{"type":"v1","addr":"172.21.15.81:6823","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":12193},{"type":"v1","addr":"172.21.15.81:6821","nonce":12193}]},"public_addr":"172.21.15.81:6817/12193","cluster_addr":"172.21.15.81:6819/12193","heartbeat_back_addr":"172.21.15.81:6823/12193","heartbeat_front_addr":"172.21.15.81:6821/12193","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:50.879921+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:50.648740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-10-05T11:54:50.971513+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-10-05T11:54:59.466 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early tell osd.0 flush_pg_stats 2020-10-05T11:54:59.629 INFO:teuthology.orchestra.run.smithi081.stdout:34359738372 2020-10-05T11:54:59.629 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early tell osd.1 flush_pg_stats 2020-10-05T11:54:59.791 INFO:teuthology.orchestra.run.smithi081.stdout:34359738371 2020-10-05T11:54:59.792 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early tell osd.2 flush_pg_stats 2020-10-05T11:54:59.953 INFO:teuthology.orchestra.run.smithi081.stdout:34359738371 2020-10-05T11:54:59.953 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early osd last-stat-seq osd.0 2020-10-05T11:55:00.246 INFO:teuthology.orchestra.run.smithi081.stdout:34359738371 2020-10-05T11:55:00.261 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738371 for osd.0 2020-10-05T11:55:01.262 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early osd last-stat-seq osd.0 2020-10-05T11:55:01.561 INFO:teuthology.orchestra.run.smithi081.stdout:34359738371 2020-10-05T11:55:01.575 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738371 for osd.0 2020-10-05T11:55:02.576 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early osd last-stat-seq osd.0 2020-10-05T11:55:02.869 INFO:teuthology.orchestra.run.smithi081.stdout:34359738372 2020-10-05T11:55:02.882 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738372 for osd.0 2020-10-05T11:55:02.883 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early osd last-stat-seq osd.1 2020-10-05T11:55:03.168 INFO:teuthology.orchestra.run.smithi081.stdout:34359738371 2020-10-05T11:55:03.182 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738371 for osd.1 2020-10-05T11:55:03.182 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early osd last-stat-seq osd.2 2020-10-05T11:55:03.477 INFO:teuthology.orchestra.run.smithi081.stdout:34359738371 2020-10-05T11:55:03.491 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738371 for osd.2 2020-10-05T11:55:03.491 INFO:tasks.ceph.ceph_manager.c2:waiting for clean 2020-10-05T11:55:03.492 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early pg dump --format=json 2020-10-05T11:55:03.770 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:55:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2020-10-05T11:55:03.784 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2020-10-05T11:55:03.344327+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":14680,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":314558120,"statfs":{"total":322122547200,"available":322107514880,"internally_reserved":0,"allocated":327680,"data_stored":92382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.749911"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.612168+0000","last_change":"2020-10-05T11:54:57.610375+0000","last_active":"2020-10-05T11:54:57.612168+0000","last_peered":"2020-10-05T11:54:57.612168+0000","last_clean":"2020-10-05T11:54:57.612168+0000","last_became_active":"2020-10-05T11:54:57.609934+0000","last_became_peered":"2020-10-05T11:54:57.609934+0000","last_unstale":"2020-10-05T11:54:57.612168+0000","last_undegraded":"2020-10-05T11:54:57.612168+0000","last_fullsized":"2020-10-05T11:54:57.612168+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.612108+0000","last_change":"2020-10-05T11:54:57.610177+0000","last_active":"2020-10-05T11:54:57.612108+0000","last_peered":"2020-10-05T11:54:57.612108+0000","last_clean":"2020-10-05T11:54:57.612108+0000","last_became_active":"2020-10-05T11:54:57.609703+0000","last_became_peered":"2020-10-05T11:54:57.609703+0000","last_unstale":"2020-10-05T11:54:57.612108+0000","last_undegraded":"2020-10-05T11:54:57.612108+0000","last_fullsized":"2020-10-05T11:54:57.612108+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.610502+0000","last_change":"2020-10-05T11:54:57.607359+0000","last_active":"2020-10-05T11:54:57.610502+0000","last_peered":"2020-10-05T11:54:57.610502+0000","last_clean":"2020-10-05T11:54:57.610502+0000","last_became_active":"2020-10-05T11:54:57.606674+0000","last_became_peered":"2020-10-05T11:54:57.606674+0000","last_unstale":"2020-10-05T11:54:57.610502+0000","last_undegraded":"2020-10-05T11:54:57.610502+0000","last_fullsized":"2020-10-05T11:54:57.610502+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"8","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.606309+0000","last_change":"2020-10-05T11:54:57.606309+0000","last_active":"2020-10-05T11:54:57.606309+0000","last_peered":"2020-10-05T11:54:57.606309+0000","last_clean":"2020-10-05T11:54:57.606309+0000","last_became_active":"2020-10-05T11:54:57.605568+0000","last_became_peered":"2020-10-05T11:54:57.605568+0000","last_unstale":"2020-10-05T11:54:57.606309+0000","last_undegraded":"2020-10-05T11:54:57.606309+0000","last_fullsized":"2020-10-05T11:54:57.606309+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"9'1","reported_seq":"13","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.602467+0000","last_change":"2020-10-05T11:54:53.992121+0000","last_active":"2020-10-05T11:54:57.602467+0000","last_peered":"2020-10-05T11:54:57.602467+0000","last_clean":"2020-10-05T11:54:57.602467+0000","last_became_active":"2020-10-05T11:54:53.990369+0000","last_became_peered":"2020-10-05T11:54:53.990369+0000","last_unstale":"2020-10-05T11:54:57.602467+0000","last_undegraded":"2020-10-05T11:54:57.602467+0000","last_fullsized":"2020-10-05T11:54:57.602467+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:51.530223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:51.530223+0000","last_clean_scrub_stamp":"2020-10-05T11:54:51.530223+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.611232+0000","last_change":"2020-10-05T11:54:57.609415+0000","last_active":"2020-10-05T11:54:57.611232+0000","last_peered":"2020-10-05T11:54:57.611232+0000","last_clean":"2020-10-05T11:54:57.611232+0000","last_became_active":"2020-10-05T11:54:57.608980+0000","last_became_peered":"2020-10-05T11:54:57.608980+0000","last_unstale":"2020-10-05T11:54:57.611232+0000","last_undegraded":"2020-10-05T11:54:57.611232+0000","last_fullsized":"2020-10-05T11:54:57.611232+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"8","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.607564+0000","last_change":"2020-10-05T11:54:57.607564+0000","last_active":"2020-10-05T11:54:57.607564+0000","last_peered":"2020-10-05T11:54:57.607564+0000","last_clean":"2020-10-05T11:54:57.607564+0000","last_became_active":"2020-10-05T11:54:57.607132+0000","last_became_peered":"2020-10-05T11:54:57.607132+0000","last_unstale":"2020-10-05T11:54:57.607564+0000","last_undegraded":"2020-10-05T11:54:57.607564+0000","last_fullsized":"2020-10-05T11:54:57.607564+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"8","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.608437+0000","last_change":"2020-10-05T11:54:57.608437+0000","last_active":"2020-10-05T11:54:57.608437+0000","last_peered":"2020-10-05T11:54:57.608437+0000","last_clean":"2020-10-05T11:54:57.608437+0000","last_became_active":"2020-10-05T11:54:57.608033+0000","last_became_peered":"2020-10-05T11:54:57.608033+0000","last_unstale":"2020-10-05T11:54:57.608437+0000","last_undegraded":"2020-10-05T11:54:57.608437+0000","last_fullsized":"2020-10-05T11:54:57.608437+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.611226+0000","last_change":"2020-10-05T11:54:57.609627+0000","last_active":"2020-10-05T11:54:57.611226+0000","last_peered":"2020-10-05T11:54:57.611226+0000","last_clean":"2020-10-05T11:54:57.611226+0000","last_became_active":"2020-10-05T11:54:57.609239+0000","last_became_peered":"2020-10-05T11:54:57.609239+0000","last_unstale":"2020-10-05T11:54:57.611226+0000","last_undegraded":"2020-10-05T11:54:57.611226+0000","last_fullsized":"2020-10-05T11:54:57.611226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4848,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":104852752,"statfs":{"total":107374182400,"available":107369218048,"internally_reserved":0,"allocated":106496,"data_stored":29623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0649999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4912,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852688,"statfs":{"total":107374182400,"available":107369152512,"internally_reserved":0,"allocated":106496,"data_stored":29623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4920,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852680,"statfs":{"total":107374182400,"available":107369144320,"internally_reserved":0,"allocated":114688,"data_stored":33136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2669999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.679}]}]}]}} 2020-10-05T11:55:03.786 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early pg dump --format=json 2020-10-05T11:55:04.068 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:55:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2020-10-05T11:55:04.081 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2020-10-05T11:55:03.344327+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":14680,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":14336,"kb_avail":314558120,"statfs":{"total":322122547200,"available":322107514880,"internally_reserved":0,"allocated":327680,"data_stored":92382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14680064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.749911"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.612168+0000","last_change":"2020-10-05T11:54:57.610375+0000","last_active":"2020-10-05T11:54:57.612168+0000","last_peered":"2020-10-05T11:54:57.612168+0000","last_clean":"2020-10-05T11:54:57.612168+0000","last_became_active":"2020-10-05T11:54:57.609934+0000","last_became_peered":"2020-10-05T11:54:57.609934+0000","last_unstale":"2020-10-05T11:54:57.612168+0000","last_undegraded":"2020-10-05T11:54:57.612168+0000","last_fullsized":"2020-10-05T11:54:57.612168+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.612108+0000","last_change":"2020-10-05T11:54:57.610177+0000","last_active":"2020-10-05T11:54:57.612108+0000","last_peered":"2020-10-05T11:54:57.612108+0000","last_clean":"2020-10-05T11:54:57.612108+0000","last_became_active":"2020-10-05T11:54:57.609703+0000","last_became_peered":"2020-10-05T11:54:57.609703+0000","last_unstale":"2020-10-05T11:54:57.612108+0000","last_undegraded":"2020-10-05T11:54:57.612108+0000","last_fullsized":"2020-10-05T11:54:57.612108+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.610502+0000","last_change":"2020-10-05T11:54:57.607359+0000","last_active":"2020-10-05T11:54:57.610502+0000","last_peered":"2020-10-05T11:54:57.610502+0000","last_clean":"2020-10-05T11:54:57.610502+0000","last_became_active":"2020-10-05T11:54:57.606674+0000","last_became_peered":"2020-10-05T11:54:57.606674+0000","last_unstale":"2020-10-05T11:54:57.610502+0000","last_undegraded":"2020-10-05T11:54:57.610502+0000","last_fullsized":"2020-10-05T11:54:57.610502+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"8","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.606309+0000","last_change":"2020-10-05T11:54:57.606309+0000","last_active":"2020-10-05T11:54:57.606309+0000","last_peered":"2020-10-05T11:54:57.606309+0000","last_clean":"2020-10-05T11:54:57.606309+0000","last_became_active":"2020-10-05T11:54:57.605568+0000","last_became_peered":"2020-10-05T11:54:57.605568+0000","last_unstale":"2020-10-05T11:54:57.606309+0000","last_undegraded":"2020-10-05T11:54:57.606309+0000","last_fullsized":"2020-10-05T11:54:57.606309+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"9'1","reported_seq":"13","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.602467+0000","last_change":"2020-10-05T11:54:53.992121+0000","last_active":"2020-10-05T11:54:57.602467+0000","last_peered":"2020-10-05T11:54:57.602467+0000","last_clean":"2020-10-05T11:54:57.602467+0000","last_became_active":"2020-10-05T11:54:53.990369+0000","last_became_peered":"2020-10-05T11:54:53.990369+0000","last_unstale":"2020-10-05T11:54:57.602467+0000","last_undegraded":"2020-10-05T11:54:57.602467+0000","last_fullsized":"2020-10-05T11:54:57.602467+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:51.530223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:51.530223+0000","last_clean_scrub_stamp":"2020-10-05T11:54:51.530223+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.611232+0000","last_change":"2020-10-05T11:54:57.609415+0000","last_active":"2020-10-05T11:54:57.611232+0000","last_peered":"2020-10-05T11:54:57.611232+0000","last_clean":"2020-10-05T11:54:57.611232+0000","last_became_active":"2020-10-05T11:54:57.608980+0000","last_became_peered":"2020-10-05T11:54:57.608980+0000","last_unstale":"2020-10-05T11:54:57.611232+0000","last_undegraded":"2020-10-05T11:54:57.611232+0000","last_fullsized":"2020-10-05T11:54:57.611232+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"8","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.607564+0000","last_change":"2020-10-05T11:54:57.607564+0000","last_active":"2020-10-05T11:54:57.607564+0000","last_peered":"2020-10-05T11:54:57.607564+0000","last_clean":"2020-10-05T11:54:57.607564+0000","last_became_active":"2020-10-05T11:54:57.607132+0000","last_became_peered":"2020-10-05T11:54:57.607132+0000","last_unstale":"2020-10-05T11:54:57.607564+0000","last_undegraded":"2020-10-05T11:54:57.607564+0000","last_fullsized":"2020-10-05T11:54:57.607564+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"8","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.608437+0000","last_change":"2020-10-05T11:54:57.608437+0000","last_active":"2020-10-05T11:54:57.608437+0000","last_peered":"2020-10-05T11:54:57.608437+0000","last_clean":"2020-10-05T11:54:57.608437+0000","last_became_active":"2020-10-05T11:54:57.608033+0000","last_became_peered":"2020-10-05T11:54:57.608033+0000","last_unstale":"2020-10-05T11:54:57.608437+0000","last_undegraded":"2020-10-05T11:54:57.608437+0000","last_fullsized":"2020-10-05T11:54:57.608437+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2020-10-05T11:54:57.611226+0000","last_change":"2020-10-05T11:54:57.609627+0000","last_active":"2020-10-05T11:54:57.611226+0000","last_peered":"2020-10-05T11:54:57.611226+0000","last_clean":"2020-10-05T11:54:57.611226+0000","last_became_active":"2020-10-05T11:54:57.609239+0000","last_became_peered":"2020-10-05T11:54:57.609239+0000","last_unstale":"2020-10-05T11:54:57.611226+0000","last_undegraded":"2020-10-05T11:54:57.611226+0000","last_fullsized":"2020-10-05T11:54:57.611226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-05T11:54:56.577329+0000","last_clean_scrub_stamp":"2020-10-05T11:54:56.577329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4848,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":104852752,"statfs":{"total":107374182400,"available":107369218048,"internally_reserved":0,"allocated":106496,"data_stored":29623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0649999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4912,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852688,"statfs":{"total":107374182400,"available":107369152512,"internally_reserved":0,"allocated":106496,"data_stored":29623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":4920,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":104852680,"statfs":{"total":107374182400,"available":107369144320,"internally_reserved":0,"allocated":114688,"data_stored":33136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2669999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.679}]}]}]}} 2020-10-05T11:55:04.083 INFO:tasks.ceph.ceph_manager.c2:clean! 2020-10-05T11:55:04.083 INFO:tasks.ceph:Waiting until ceph cluster c2 is healthy... 2020-10-05T11:55:04.083 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy 2020-10-05T11:55:04.083 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 --log-early health --format=json 2020-10-05T11:55:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: 2020-10-05T11:55:04.436 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-10-05T11:55:04.437 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy done 2020-10-05T11:55:04.437 INFO:teuthology.run_tasks:Running task rgw... 2020-10-05T11:55:04.454 DEBUG:tasks.rgw:config is {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}} 2020-10-05T11:55:04.455 DEBUG:tasks.rgw:client list is dict_keys(['c1.client.0', 'c1.client.1', 'c2.client.0', 'c2.client.1']) 2020-10-05T11:55:04.455 INFO:tasks.rgw:Creating data pools 2020-10-05T11:55:04.456 DEBUG:tasks.rgw:Obtaining remote for client c1.client.0 2020-10-05T11:55:04.456 INFO:teuthology.orchestra.run.smithi158:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2020-10-05T11:55:05.220 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'default.rgw.buckets.data' created 2020-10-05T11:55:05.235 INFO:teuthology.orchestra.run.smithi158:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2020-10-05T11:55:06.240 INFO:teuthology.orchestra.run.smithi158.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2020-10-05T11:55:06.259 INFO:teuthology.orchestra.run.smithi158:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2020-10-05T11:55:07.250 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'default.rgw.buckets.index' created 2020-10-05T11:55:07.264 INFO:teuthology.orchestra.run.smithi158:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2020-10-05T11:55:08.271 INFO:teuthology.orchestra.run.smithi158.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2020-10-05T11:55:08.297 DEBUG:tasks.rgw:Obtaining remote for client c1.client.1 2020-10-05T11:55:08.297 INFO:teuthology.orchestra.run.smithi158:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2020-10-05T11:55:08.572 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'default.rgw.buckets.data' already exists 2020-10-05T11:55:08.583 INFO:teuthology.orchestra.run.smithi158:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2020-10-05T11:55:09.254 INFO:teuthology.orchestra.run.smithi158.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2020-10-05T11:55:09.268 INFO:teuthology.orchestra.run.smithi158:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2020-10-05T11:55:09.551 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'default.rgw.buckets.index' already exists 2020-10-05T11:55:09.562 INFO:teuthology.orchestra.run.smithi158:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2020-10-05T11:55:10.272 INFO:teuthology.orchestra.run.smithi158.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2020-10-05T11:55:10.286 DEBUG:tasks.rgw:Obtaining remote for client c2.client.0 2020-10-05T11:55:10.287 INFO:teuthology.orchestra.run.smithi081:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2020-10-05T11:55:11.526 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'default.rgw.buckets.data' created 2020-10-05T11:55:11.540 INFO:teuthology.orchestra.run.smithi081:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2020-10-05T11:55:12.544 INFO:teuthology.orchestra.run.smithi081.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2020-10-05T11:55:12.562 INFO:teuthology.orchestra.run.smithi081:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2020-10-05T11:55:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'default.rgw.buckets.index' created 2020-10-05T11:55:13.555 INFO:teuthology.orchestra.run.smithi081:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2020-10-05T11:55:14.561 INFO:teuthology.orchestra.run.smithi081.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2020-10-05T11:55:14.591 DEBUG:tasks.rgw:Obtaining remote for client c2.client.1 2020-10-05T11:55:14.592 INFO:teuthology.orchestra.run.smithi081:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2020-10-05T11:55:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'default.rgw.buckets.data' already exists 2020-10-05T11:55:14.877 INFO:teuthology.orchestra.run.smithi081:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2020-10-05T11:55:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2020-10-05T11:55:15.557 INFO:teuthology.orchestra.run.smithi081:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2020-10-05T11:55:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'default.rgw.buckets.index' already exists 2020-10-05T11:55:15.864 INFO:teuthology.orchestra.run.smithi081:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2020-10-05T11:55:16.545 INFO:teuthology.orchestra.run.smithi081.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2020-10-05T11:55:16.558 DEBUG:tasks.rgw:Pools created 2020-10-05T11:55:16.559 INFO:tasks.rgw:Configuring compression type = random 2020-10-05T11:55:16.559 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'list'] 2020-10-05T11:55:16.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'list'] 2020-10-05T11:55:16.560 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user list 2020-10-05T11:55:16.596 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:16.596 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:16.605 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:16.604+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.211 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.208+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:18.211 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.208+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.211 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.208+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:18.212 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.208+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.212 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.208+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:18.212 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.208+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.220 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.220+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:18.239 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.236+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.240 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.236+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:18.240 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.236+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.241 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.240+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:18.241 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.240+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.241 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.240+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:18.241 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.240+0000 7f3d8ea6b0c0 10 cannot find current period zonegroup using local zonegroup 2020-10-05T11:55:18.241 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.240+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.242 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.240+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:18.242 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.240+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.242 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.240+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:18.242 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.240+0000 7f3d8ea6b0c0 10 Creating default zonegroup 2020-10-05T11:55:18.242 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.240+0000 7f3d8ea6b0c0 20 get_system_obj_state: rctx=0x7ffe50750450 obj=:.pools.avail state=0x5566e0fff2e0 s->prefetch_data=0 2020-10-05T11:55:18.243 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.240+0000 7f3d8ea6b0c0 10 couldn't find old data placement pools config, setting up new ones for the zone 2020-10-05T11:55:18.258 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.256+0000 7f3d8ea6b0c0 10 WARNING: store->list_zones() returned r=-2 2020-10-05T11:55:18.259 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.256+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.259 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.256+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:18.263 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.260+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.264 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.260+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:18.264 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.260+0000 7f3d8ea6b0c0 10 could not read realm id: (2) No such file or directory 2020-10-05T11:55:18.264 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.260+0000 7f3d8ea6b0c0 10 WARNING: failed to set zone as default, r=-22 2020-10-05T11:55:18.264 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.260+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.264 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.264+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:18.269 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.268+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.270 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.268+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=0 bl.length=873 2020-10-05T11:55:18.270 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.268+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.274 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.272+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=0 bl.length=358 2020-10-05T11:55:18.274 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.272+0000 7f3d8ea6b0c0 20 zonegroup default 2020-10-05T11:55:18.274 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.272+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.275 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.272+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:18.275 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.272+0000 7f3d8ea6b0c0 10 Cannot find current period zone using local zone 2020-10-05T11:55:18.275 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.272+0000 7f3d8ea6b0c0 10 Using default name default 2020-10-05T11:55:18.275 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.272+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.276 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.276+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:18.276 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.276+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:18.276 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.276+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=0 bl.length=873 2020-10-05T11:55:18.277 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.276+0000 7f3d8ea6b0c0 20 zone default found 2020-10-05T11:55:18.277 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:18.276+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:20.237 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:20.236+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:20.237 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:20.236+0000 7f3d8ea6b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:20.238 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:20.236+0000 7f3d8ea6b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:20.238 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:20.236+0000 7f3d8ea6b0c0 20 started sync module instance, tier type = 2020-10-05T11:55:20.238 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:20.236+0000 7f3d8ea6b0c0 20 started zone id=1f5ec747-7416-477d-bc8b-e5f1fa7b81af (name=default) with tier type = 2020-10-05T11:55:22.316 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:22.312+0000 7f3d8ea6b0c0 20 add_watcher() i=0 2020-10-05T11:55:22.316 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:22.312+0000 7f3d8ea6b0c0 20 add_watcher() i=1 2020-10-05T11:55:22.316 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:22.312+0000 7f3d8ea6b0c0 20 add_watcher() i=2 2020-10-05T11:55:22.317 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:22.312+0000 7f3d8ea6b0c0 20 add_watcher() i=3 2020-10-05T11:55:22.317 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:22.312+0000 7f3d8ea6b0c0 20 add_watcher() i=4 2020-10-05T11:55:22.317 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:22.312+0000 7f3d8ea6b0c0 20 add_watcher() i=5 2020-10-05T11:55:22.317 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:22.312+0000 7f3d8ea6b0c0 20 add_watcher() i=6 2020-10-05T11:55:22.318 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:22.316+0000 7f3d8ea6b0c0 20 add_watcher() i=7 2020-10-05T11:55:22.318 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:22.316+0000 7f3d8ea6b0c0 2 all 8 watchers are set, enabling cache 2020-10-05T11:55:22.348 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:22.348+0000 7f3d4bfe7700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-10-05T11:55:22.349 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:22.348+0000 7f3d8ea6b0c0 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-10-05T11:55:22.349 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:22.348+0000 7f3d8ea6b0c0 20 check_secure_mon_conn(): mode 1 is insecure 2020-10-05T11:55:26.283 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.280+0000 7f3d8ea6b0c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2020-10-05T11:55:26.396 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.396+0000 7f3cb2ffd700 20 reqs_thread_entry: start 2020-10-05T11:55:26.396 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.396+0000 7f3cb0ff9700 20 reqs_thread_entry: start 2020-10-05T11:55:26.397 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.396+0000 7f3d8ea6b0c0 20 init_complete bucket index max shards: 11 2020-10-05T11:55:26.397 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.396+0000 7f3d8ea6b0c0 10 Started notification manager with: 1 workers 2020-10-05T11:55:26.397 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.396+0000 7f3ca27fc700 20 reqs_thread_entry: start 2020-10-05T11:55:26.398 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.396+0000 7f3ca2ffd700 20 INFO: next queues processing will happen at: Mon Oct 5 11:55:56 2020 2020-10-05T11:55:26.398 INFO:teuthology.orchestra.run.smithi158.stderr: 2020-10-05T11:55:26.428 INFO:teuthology.orchestra.run.smithi158.stdout:[] 2020-10-05T11:55:26.428 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.428+0000 7f3d8ea6b0c0 20 remove_watcher() i=0 2020-10-05T11:55:26.429 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.428+0000 7f3d8ea6b0c0 2 removed watcher, disabling cache 2020-10-05T11:55:26.431 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.428+0000 7f3d8ea6b0c0 20 remove_watcher() i=1 2020-10-05T11:55:26.434 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.432+0000 7f3d8ea6b0c0 20 remove_watcher() i=2 2020-10-05T11:55:26.437 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.436+0000 7f3d8ea6b0c0 20 remove_watcher() i=3 2020-10-05T11:55:26.440 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.440+0000 7f3d8ea6b0c0 20 remove_watcher() i=4 2020-10-05T11:55:26.442 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.440+0000 7f3d8ea6b0c0 20 remove_watcher() i=5 2020-10-05T11:55:26.445 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.444+0000 7f3d8ea6b0c0 20 remove_watcher() i=6 2020-10-05T11:55:26.450 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.448+0000 7f3d8ea6b0c0 20 remove_watcher() i=7 2020-10-05T11:55:26.452 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.452+0000 7f3d4bfe7700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-10-05T11:55:26.461 DEBUG:tasks.util.rgw: json result: [] 2020-10-05T11:55:26.462 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-10-05T11:55:26.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-10-05T11:55:26.462 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2020-10-05T11:55:26.542 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:26.543 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:26.553 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.552+0000 7f11e8e1a0c0 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-10-05T11:55:26.554 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.552+0000 7f11e8e1a0c0 20 check_secure_mon_conn(): mode 1 is insecure 2020-10-05T11:55:26.559 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.556+0000 7f114d7fa700 20 reqs_thread_entry: start 2020-10-05T11:55:26.559 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.556+0000 7f11e8e1a0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.560 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.560+0000 7f11e8e1a0c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:26.561 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.560+0000 7f11e8e1a0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.562 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.560+0000 7f11e8e1a0c0 20 rados_obj.operate() r=0 bl.length=873 2020-10-05T11:55:26.562 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.560+0000 7f11e8e1a0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.563 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.560+0000 7f11e8e1a0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:26.563 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.560+0000 7f11e8e1a0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.564 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.564+0000 7f11e8e1a0c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:26.564 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.564+0000 7f11e8e1a0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.565 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.564+0000 7f11e8e1a0c0 20 rados_obj.operate() r=0 bl.length=358 2020-10-05T11:55:26.573 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:55:26.574 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1f5ec747-7416-477d-bc8b-e5f1fa7b81af", 2020-10-05T11:55:26.574 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "default", 2020-10-05T11:55:26.574 INFO:teuthology.orchestra.run.smithi158.stdout: "domain_root": "default.rgw.meta:root", 2020-10-05T11:55:26.574 INFO:teuthology.orchestra.run.smithi158.stdout: "control_pool": "default.rgw.control", 2020-10-05T11:55:26.574 INFO:teuthology.orchestra.run.smithi158.stdout: "gc_pool": "default.rgw.log:gc", 2020-10-05T11:55:26.574 INFO:teuthology.orchestra.run.smithi158.stdout: "lc_pool": "default.rgw.log:lc", 2020-10-05T11:55:26.574 INFO:teuthology.orchestra.run.smithi158.stdout: "log_pool": "default.rgw.log", 2020-10-05T11:55:26.575 INFO:teuthology.orchestra.run.smithi158.stdout: "intent_log_pool": "default.rgw.log:intent", 2020-10-05T11:55:26.575 INFO:teuthology.orchestra.run.smithi158.stdout: "usage_log_pool": "default.rgw.log:usage", 2020-10-05T11:55:26.575 INFO:teuthology.orchestra.run.smithi158.stdout: "roles_pool": "default.rgw.meta:roles", 2020-10-05T11:55:26.575 INFO:teuthology.orchestra.run.smithi158.stdout: "reshard_pool": "default.rgw.log:reshard", 2020-10-05T11:55:26.575 INFO:teuthology.orchestra.run.smithi158.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2020-10-05T11:55:26.575 INFO:teuthology.orchestra.run.smithi158.stdout: "user_email_pool": "default.rgw.meta:users.email", 2020-10-05T11:55:26.575 INFO:teuthology.orchestra.run.smithi158.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2020-10-05T11:55:26.576 INFO:teuthology.orchestra.run.smithi158.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2020-10-05T11:55:26.576 INFO:teuthology.orchestra.run.smithi158.stdout: "otp_pool": "default.rgw.otp", 2020-10-05T11:55:26.576 INFO:teuthology.orchestra.run.smithi158.stdout: "system_key": { 2020-10-05T11:55:26.576 INFO:teuthology.orchestra.run.smithi158.stdout: "access_key": "", 2020-10-05T11:55:26.576 INFO:teuthology.orchestra.run.smithi158.stdout: "secret_key": "" 2020-10-05T11:55:26.576 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:55:26.576 INFO:teuthology.orchestra.run.smithi158.stdout: "placement_pools": [ 2020-10-05T11:55:26.577 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:55:26.577 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "default-placement", 2020-10-05T11:55:26.577 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:55:26.577 INFO:teuthology.orchestra.run.smithi158.stdout: "index_pool": "default.rgw.buckets.index", 2020-10-05T11:55:26.577 INFO:teuthology.orchestra.run.smithi158.stdout: "storage_classes": { 2020-10-05T11:55:26.577 INFO:teuthology.orchestra.run.smithi158.stdout: "STANDARD": { 2020-10-05T11:55:26.577 INFO:teuthology.orchestra.run.smithi158.stdout: "data_pool": "default.rgw.buckets.data", 2020-10-05T11:55:26.577 INFO:teuthology.orchestra.run.smithi158.stdout: "compression_type": "random" 2020-10-05T11:55:26.578 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:26.578 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:55:26.578 INFO:teuthology.orchestra.run.smithi158.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2020-10-05T11:55:26.578 INFO:teuthology.orchestra.run.smithi158.stdout: "index_type": 0 2020-10-05T11:55:26.578 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:26.578 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:26.578 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:55:26.579 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_id": "", 2020-10-05T11:55:26.579 INFO:teuthology.orchestra.run.smithi158.stdout: "notif_pool": "default.rgw.log:notif" 2020-10-05T11:55:26.579 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:55:26.580 DEBUG:tasks.util.rgw: json result: {'id': '1f5ec747-7416-477d-bc8b-e5f1fa7b81af', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2020-10-05T11:55:26.580 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['user', 'list'] 2020-10-05T11:55:26.580 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'user', 'list'] 2020-10-05T11:55:26.581 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 user list 2020-10-05T11:55:26.657 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:26.658 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:26.668 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.668+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.671 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.668+0000 7f0ee60fa0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:26.671 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.668+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.671 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.668+0000 7f0ee60fa0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:26.672 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.668+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.672 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.672+0000 7f0ee60fa0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:26.672 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.672+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.673 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.672+0000 7f0ee60fa0c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:26.695 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.692+0000 7f0ee60fa0c0 20 RGWRados::pool_iterate: got zone_info.1f5ec747-7416-477d-bc8b-e5f1fa7b81af 2020-10-05T11:55:26.696 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.692+0000 7f0ee60fa0c0 20 RGWRados::pool_iterate: got zonegroup_info.18bcd58d-67db-49a5-8094-5c41933b9ce2 2020-10-05T11:55:26.696 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.692+0000 7f0ee60fa0c0 20 RGWRados::pool_iterate: got zone_names.default 2020-10-05T11:55:26.696 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.692+0000 7f0ee60fa0c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-10-05T11:55:26.696 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.692+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.697 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.696+0000 7f0ee60fa0c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:26.697 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.696+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.697 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.696+0000 7f0ee60fa0c0 20 rados_obj.operate() r=0 bl.length=889 2020-10-05T11:55:26.697 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.696+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.697 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.696+0000 7f0ee60fa0c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:26.698 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.696+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.698 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.696+0000 7f0ee60fa0c0 20 rados_obj.operate() r=0 bl.length=358 2020-10-05T11:55:26.699 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.696+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.699 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.696+0000 7f0ee60fa0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:26.699 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.696+0000 7f0ee60fa0c0 10 cannot find current period zonegroup using local zonegroup 2020-10-05T11:55:26.699 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.696+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.700 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.700+0000 7f0ee60fa0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:26.700 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.700+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.701 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.700+0000 7f0ee60fa0c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:26.701 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.700+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.702 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.700+0000 7f0ee60fa0c0 20 rados_obj.operate() r=0 bl.length=358 2020-10-05T11:55:26.702 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.700+0000 7f0ee60fa0c0 20 zonegroup default 2020-10-05T11:55:26.702 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.700+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.703 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.700+0000 7f0ee60fa0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:26.703 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.700+0000 7f0ee60fa0c0 10 Cannot find current period zone using local zone 2020-10-05T11:55:26.703 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.700+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.703 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.700+0000 7f0ee60fa0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:26.704 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.700+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.704 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.704+0000 7f0ee60fa0c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:26.705 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.704+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.705 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.704+0000 7f0ee60fa0c0 20 rados_obj.operate() r=0 bl.length=889 2020-10-05T11:55:26.705 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.704+0000 7f0ee60fa0c0 20 zone default found 2020-10-05T11:55:26.705 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.704+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.706 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.704+0000 7f0ee60fa0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:26.706 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.704+0000 7f0ee60fa0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:26.707 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.704+0000 7f0ee60fa0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:26.707 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.704+0000 7f0ee60fa0c0 20 started sync module instance, tier type = 2020-10-05T11:55:26.707 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.704+0000 7f0ee60fa0c0 20 started zone id=1f5ec747-7416-477d-bc8b-e5f1fa7b81af (name=default) with tier type = 2020-10-05T11:55:26.742 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.740+0000 7f0ee60fa0c0 20 add_watcher() i=0 2020-10-05T11:55:26.742 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.740+0000 7f0ee60fa0c0 20 add_watcher() i=1 2020-10-05T11:55:26.743 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.740+0000 7f0ee60fa0c0 20 add_watcher() i=2 2020-10-05T11:55:26.743 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.740+0000 7f0ee60fa0c0 20 add_watcher() i=3 2020-10-05T11:55:26.743 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.740+0000 7f0ee60fa0c0 20 add_watcher() i=4 2020-10-05T11:55:26.743 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.740+0000 7f0ee60fa0c0 20 add_watcher() i=5 2020-10-05T11:55:26.743 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.740+0000 7f0ee60fa0c0 20 add_watcher() i=6 2020-10-05T11:55:26.744 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.744+0000 7f0ee60fa0c0 20 add_watcher() i=7 2020-10-05T11:55:26.744 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.744+0000 7f0ee60fa0c0 2 all 8 watchers are set, enabling cache 2020-10-05T11:55:26.768 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.768+0000 7f0ea37de700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-10-05T11:55:26.768 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.768+0000 7f0ee60fa0c0 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-10-05T11:55:26.769 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.768+0000 7f0ee60fa0c0 20 check_secure_mon_conn(): mode 1 is insecure 2020-10-05T11:55:26.862 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.860+0000 7f0e127fc700 20 reqs_thread_entry: start 2020-10-05T11:55:26.863 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.860+0000 7f0e03fff700 20 reqs_thread_entry: start 2020-10-05T11:55:26.863 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.860+0000 7f0ee60fa0c0 20 init_complete bucket index max shards: 11 2020-10-05T11:55:26.864 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.860+0000 7f0ee60fa0c0 10 Started notification manager with: 1 workers 2020-10-05T11:55:26.864 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.860+0000 7f0e027fc700 20 INFO: next queues processing will happen at: Mon Oct 5 11:55:57 2020 2020-10-05T11:55:26.864 INFO:teuthology.orchestra.run.smithi158.stderr: 2020-10-05T11:55:26.864 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.860+0000 7f0e01ffb700 20 reqs_thread_entry: start 2020-10-05T11:55:26.891 INFO:teuthology.orchestra.run.smithi158.stdout:[] 2020-10-05T11:55:26.892 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.888+0000 7f0ee60fa0c0 20 remove_watcher() i=0 2020-10-05T11:55:26.892 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.888+0000 7f0ee60fa0c0 2 removed watcher, disabling cache 2020-10-05T11:55:26.893 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.892+0000 7f0ee60fa0c0 20 remove_watcher() i=1 2020-10-05T11:55:26.895 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.892+0000 7f0ee60fa0c0 20 remove_watcher() i=2 2020-10-05T11:55:26.897 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.896+0000 7f0ee60fa0c0 20 remove_watcher() i=3 2020-10-05T11:55:26.900 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.900+0000 7f0ee60fa0c0 20 remove_watcher() i=4 2020-10-05T11:55:26.903 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.900+0000 7f0ee60fa0c0 20 remove_watcher() i=5 2020-10-05T11:55:26.905 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.904+0000 7f0ee60fa0c0 20 remove_watcher() i=6 2020-10-05T11:55:26.908 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.908+0000 7f0ee60fa0c0 20 remove_watcher() i=7 2020-10-05T11:55:26.909 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:26.908+0000 7f0ea37de700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-10-05T11:55:26.915 DEBUG:tasks.util.rgw: json result: [] 2020-10-05T11:55:26.916 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-10-05T11:55:26.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-10-05T11:55:26.916 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2020-10-05T11:55:26.996 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:26.997 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:27.006 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:27.004+0000 7f7f7575b0c0 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-10-05T11:55:27.006 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:27.004+0000 7f7f7575b0c0 20 check_secure_mon_conn(): mode 1 is insecure 2020-10-05T11:55:27.013 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:27.012+0000 7f7eaa7fc700 20 reqs_thread_entry: start 2020-10-05T11:55:27.014 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:27.012+0000 7f7f7575b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:27.015 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:27.012+0000 7f7f7575b0c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:27.015 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:27.012+0000 7f7f7575b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:27.017 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:27.016+0000 7f7f7575b0c0 20 rados_obj.operate() r=0 bl.length=889 2020-10-05T11:55:27.018 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:27.016+0000 7f7f7575b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:27.018 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:27.016+0000 7f7f7575b0c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:27.018 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:27.016+0000 7f7f7575b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:27.019 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:27.016+0000 7f7f7575b0c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:27.019 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:27.016+0000 7f7f7575b0c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:27.019 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:27.020+0000 7f7f7575b0c0 20 rados_obj.operate() r=0 bl.length=358 2020-10-05T11:55:27.027 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:55:27.027 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1f5ec747-7416-477d-bc8b-e5f1fa7b81af", 2020-10-05T11:55:27.027 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "default", 2020-10-05T11:55:27.027 INFO:teuthology.orchestra.run.smithi158.stdout: "domain_root": "default.rgw.meta:root", 2020-10-05T11:55:27.027 INFO:teuthology.orchestra.run.smithi158.stdout: "control_pool": "default.rgw.control", 2020-10-05T11:55:27.028 INFO:teuthology.orchestra.run.smithi158.stdout: "gc_pool": "default.rgw.log:gc", 2020-10-05T11:55:27.028 INFO:teuthology.orchestra.run.smithi158.stdout: "lc_pool": "default.rgw.log:lc", 2020-10-05T11:55:27.028 INFO:teuthology.orchestra.run.smithi158.stdout: "log_pool": "default.rgw.log", 2020-10-05T11:55:27.028 INFO:teuthology.orchestra.run.smithi158.stdout: "intent_log_pool": "default.rgw.log:intent", 2020-10-05T11:55:27.028 INFO:teuthology.orchestra.run.smithi158.stdout: "usage_log_pool": "default.rgw.log:usage", 2020-10-05T11:55:27.028 INFO:teuthology.orchestra.run.smithi158.stdout: "roles_pool": "default.rgw.meta:roles", 2020-10-05T11:55:27.028 INFO:teuthology.orchestra.run.smithi158.stdout: "reshard_pool": "default.rgw.log:reshard", 2020-10-05T11:55:27.029 INFO:teuthology.orchestra.run.smithi158.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2020-10-05T11:55:27.029 INFO:teuthology.orchestra.run.smithi158.stdout: "user_email_pool": "default.rgw.meta:users.email", 2020-10-05T11:55:27.029 INFO:teuthology.orchestra.run.smithi158.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2020-10-05T11:55:27.029 INFO:teuthology.orchestra.run.smithi158.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2020-10-05T11:55:27.029 INFO:teuthology.orchestra.run.smithi158.stdout: "otp_pool": "default.rgw.otp", 2020-10-05T11:55:27.029 INFO:teuthology.orchestra.run.smithi158.stdout: "system_key": { 2020-10-05T11:55:27.029 INFO:teuthology.orchestra.run.smithi158.stdout: "access_key": "", 2020-10-05T11:55:27.030 INFO:teuthology.orchestra.run.smithi158.stdout: "secret_key": "" 2020-10-05T11:55:27.030 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:55:27.030 INFO:teuthology.orchestra.run.smithi158.stdout: "placement_pools": [ 2020-10-05T11:55:27.030 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:55:27.030 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "default-placement", 2020-10-05T11:55:27.030 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:55:27.030 INFO:teuthology.orchestra.run.smithi158.stdout: "index_pool": "default.rgw.buckets.index", 2020-10-05T11:55:27.031 INFO:teuthology.orchestra.run.smithi158.stdout: "storage_classes": { 2020-10-05T11:55:27.031 INFO:teuthology.orchestra.run.smithi158.stdout: "STANDARD": { 2020-10-05T11:55:27.031 INFO:teuthology.orchestra.run.smithi158.stdout: "data_pool": "default.rgw.buckets.data", 2020-10-05T11:55:27.031 INFO:teuthology.orchestra.run.smithi158.stdout: "compression_type": "random" 2020-10-05T11:55:27.031 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:27.031 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:55:27.031 INFO:teuthology.orchestra.run.smithi158.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2020-10-05T11:55:27.031 INFO:teuthology.orchestra.run.smithi158.stdout: "index_type": 0 2020-10-05T11:55:27.032 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:27.032 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:27.032 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:55:27.032 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_id": "", 2020-10-05T11:55:27.032 INFO:teuthology.orchestra.run.smithi158.stdout: "notif_pool": "default.rgw.log:notif" 2020-10-05T11:55:27.032 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:55:27.033 DEBUG:tasks.util.rgw: json result: {'id': '1f5ec747-7416-477d-bc8b-e5f1fa7b81af', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2020-10-05T11:55:27.034 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['user', 'list'] 2020-10-05T11:55:27.034 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'user', 'list'] 2020-10-05T11:55:27.034 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 user list 2020-10-05T11:55:27.071 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:27.071 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:27.084+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.180+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.180+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.180+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.180+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.180+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.180+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.180+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.200+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.200+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.200+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.204+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.204+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.204+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.204+0000 7ffbed3420c0 10 cannot find current period zonegroup using local zonegroup 2020-10-05T11:55:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.204+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.204+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.204+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.204+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:28.204 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.204+0000 7ffbed3420c0 10 Creating default zonegroup 2020-10-05T11:55:28.204 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.204+0000 7ffbed3420c0 20 get_system_obj_state: rctx=0x7ffccfb86ef0 obj=:.pools.avail state=0x564195dca2e0 s->prefetch_data=0 2020-10-05T11:55:28.204 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.204+0000 7ffbed3420c0 10 couldn't find old data placement pools config, setting up new ones for the zone 2020-10-05T11:55:28.219 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.220+0000 7ffbed3420c0 10 WARNING: store->list_zones() returned r=-2 2020-10-05T11:55:28.219 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.220+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.220 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.220+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:28.225 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.224+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.225 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.228+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:28.226 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.228+0000 7ffbed3420c0 10 could not read realm id: (2) No such file or directory 2020-10-05T11:55:28.226 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.228+0000 7ffbed3420c0 10 WARNING: failed to set zone as default, r=-22 2020-10-05T11:55:28.226 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.228+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.227 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.228+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:28.233 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.236+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.234 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.236+0000 7ffbed3420c0 20 rados_obj.operate() r=0 bl.length=873 2020-10-05T11:55:28.235 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.236+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.235 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.236+0000 7ffbed3420c0 20 rados_obj.operate() r=0 bl.length=358 2020-10-05T11:55:28.236 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.236+0000 7ffbed3420c0 20 zonegroup default 2020-10-05T11:55:28.236 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.236+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.236 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.236+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:28.236 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.236+0000 7ffbed3420c0 10 Cannot find current period zone using local zone 2020-10-05T11:55:28.236 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.236+0000 7ffbed3420c0 10 Using default name default 2020-10-05T11:55:28.237 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.236+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.237 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.240+0000 7ffbed3420c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:28.237 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.240+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:28.238 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.240+0000 7ffbed3420c0 20 rados_obj.operate() r=0 bl.length=873 2020-10-05T11:55:28.238 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.240+0000 7ffbed3420c0 20 zone default found 2020-10-05T11:55:28.238 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:28.240+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:30.196 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:30.196+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:30.196 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:30.196+0000 7ffbed3420c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:30.197 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:30.196+0000 7ffbed3420c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:30.197 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:30.196+0000 7ffbed3420c0 20 started sync module instance, tier type = 2020-10-05T11:55:30.197 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:30.196+0000 7ffbed3420c0 20 started zone id=68f77b92-3d07-47cb-bbdb-76c00e31bdf8 (name=default) with tier type = 2020-10-05T11:55:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:32.252+0000 7ffbed3420c0 20 add_watcher() i=0 2020-10-05T11:55:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:32.252+0000 7ffbed3420c0 20 add_watcher() i=1 2020-10-05T11:55:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:32.252+0000 7ffbed3420c0 20 add_watcher() i=2 2020-10-05T11:55:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:32.252+0000 7ffbed3420c0 20 add_watcher() i=3 2020-10-05T11:55:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:32.252+0000 7ffbed3420c0 20 add_watcher() i=4 2020-10-05T11:55:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:32.252+0000 7ffbed3420c0 20 add_watcher() i=5 2020-10-05T11:55:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:32.252+0000 7ffbed3420c0 20 add_watcher() i=6 2020-10-05T11:55:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:32.256+0000 7ffbed3420c0 20 add_watcher() i=7 2020-10-05T11:55:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:32.256+0000 7ffbed3420c0 2 all 8 watchers are set, enabling cache 2020-10-05T11:55:32.279 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:32.280+0000 7ffbaa7e4700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-10-05T11:55:32.280 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:32.280+0000 7ffbed3420c0 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-10-05T11:55:32.280 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:32.280+0000 7ffbed3420c0 20 check_secure_mon_conn(): mode 1 is insecure 2020-10-05T11:55:36.204 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.204+0000 7ffbed3420c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2020-10-05T11:55:36.418 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.420+0000 7ffb197fa700 20 reqs_thread_entry: start 2020-10-05T11:55:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.420+0000 7ffbed3420c0 20 init_complete bucket index max shards: 11 2020-10-05T11:55:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.420+0000 7ffb06ffd700 20 reqs_thread_entry: start 2020-10-05T11:55:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.420+0000 7ffbed3420c0 10 Started notification manager with: 1 workers 2020-10-05T11:55:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.420+0000 7ffb057fa700 20 INFO: next queues processing will happen at: Mon Oct 5 11:56:06 2020 2020-10-05T11:55:36.419 INFO:teuthology.orchestra.run.smithi081.stderr: 2020-10-05T11:55:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.420+0000 7ffb04ff9700 20 reqs_thread_entry: start 2020-10-05T11:55:36.453 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2020-10-05T11:55:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.456+0000 7ffbed3420c0 20 remove_watcher() i=0 2020-10-05T11:55:36.454 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.456+0000 7ffbed3420c0 2 removed watcher, disabling cache 2020-10-05T11:55:36.456 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.456+0000 7ffbed3420c0 20 remove_watcher() i=1 2020-10-05T11:55:36.459 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.460+0000 7ffbed3420c0 20 remove_watcher() i=2 2020-10-05T11:55:36.462 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.464+0000 7ffbed3420c0 20 remove_watcher() i=3 2020-10-05T11:55:36.465 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.468+0000 7ffbed3420c0 20 remove_watcher() i=4 2020-10-05T11:55:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.468+0000 7ffbed3420c0 20 remove_watcher() i=5 2020-10-05T11:55:36.471 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.472+0000 7ffbed3420c0 20 remove_watcher() i=6 2020-10-05T11:55:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.476+0000 7ffbed3420c0 20 remove_watcher() i=7 2020-10-05T11:55:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.476+0000 7ffbaa7e4700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-10-05T11:55:36.492 DEBUG:tasks.util.rgw: json result: [] 2020-10-05T11:55:36.493 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-10-05T11:55:36.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-10-05T11:55:36.494 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2020-10-05T11:55:36.571 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:36.572 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:36.583 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.584+0000 7f2a8ea450c0 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-10-05T11:55:36.584 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.584+0000 7f2a8ea450c0 20 check_secure_mon_conn(): mode 1 is insecure 2020-10-05T11:55:36.590 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.592+0000 7f29c3fff700 20 reqs_thread_entry: start 2020-10-05T11:55:36.590 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.592+0000 7f2a8ea450c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.591 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.592+0000 7f2a8ea450c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:36.591 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.592+0000 7f2a8ea450c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.593 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.592+0000 7f2a8ea450c0 20 rados_obj.operate() r=0 bl.length=873 2020-10-05T11:55:36.593 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.592+0000 7f2a8ea450c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.593 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.596+0000 7f2a8ea450c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:36.593 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.596+0000 7f2a8ea450c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.594 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.596+0000 7f2a8ea450c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:36.594 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.596+0000 7f2a8ea450c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.595 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.596+0000 7f2a8ea450c0 20 rados_obj.operate() r=0 bl.length=358 2020-10-05T11:55:36.602 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:55:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "68f77b92-3d07-47cb-bbdb-76c00e31bdf8", 2020-10-05T11:55:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default", 2020-10-05T11:55:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "domain_root": "default.rgw.meta:root", 2020-10-05T11:55:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "control_pool": "default.rgw.control", 2020-10-05T11:55:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "gc_pool": "default.rgw.log:gc", 2020-10-05T11:55:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "lc_pool": "default.rgw.log:lc", 2020-10-05T11:55:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "log_pool": "default.rgw.log", 2020-10-05T11:55:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "intent_log_pool": "default.rgw.log:intent", 2020-10-05T11:55:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "usage_log_pool": "default.rgw.log:usage", 2020-10-05T11:55:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "roles_pool": "default.rgw.meta:roles", 2020-10-05T11:55:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "reshard_pool": "default.rgw.log:reshard", 2020-10-05T11:55:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2020-10-05T11:55:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "user_email_pool": "default.rgw.meta:users.email", 2020-10-05T11:55:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2020-10-05T11:55:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2020-10-05T11:55:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "otp_pool": "default.rgw.otp", 2020-10-05T11:55:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "system_key": { 2020-10-05T11:55:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "access_key": "", 2020-10-05T11:55:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "secret_key": "" 2020-10-05T11:55:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:55:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "placement_pools": [ 2020-10-05T11:55:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:55:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "default-placement", 2020-10-05T11:55:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:55:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "index_pool": "default.rgw.buckets.index", 2020-10-05T11:55:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_classes": { 2020-10-05T11:55:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "STANDARD": { 2020-10-05T11:55:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "data_pool": "default.rgw.buckets.data", 2020-10-05T11:55:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "compression_type": "random" 2020-10-05T11:55:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:55:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:55:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2020-10-05T11:55:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "index_type": 0 2020-10-05T11:55:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:55:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:55:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:55:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_id": "", 2020-10-05T11:55:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "notif_pool": "default.rgw.log:notif" 2020-10-05T11:55:36.608 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:55:36.609 DEBUG:tasks.util.rgw: json result: {'id': '68f77b92-3d07-47cb-bbdb-76c00e31bdf8', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2020-10-05T11:55:36.609 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['user', 'list'] 2020-10-05T11:55:36.609 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'user', 'list'] 2020-10-05T11:55:36.610 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 user list 2020-10-05T11:55:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.700+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.700 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.700+0000 7f110af110c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:36.700 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.700+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.701 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.700+0000 7f110af110c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:36.701 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.700+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.701 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.704+0000 7f110af110c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:36.702 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.704+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.702 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.704+0000 7f110af110c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:36.727 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.728+0000 7f110af110c0 20 RGWRados::pool_iterate: got zone_info.68f77b92-3d07-47cb-bbdb-76c00e31bdf8 2020-10-05T11:55:36.727 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.728+0000 7f110af110c0 20 RGWRados::pool_iterate: got zonegroup_info.b5c9ee09-c1bc-46e9-82b6-7dd95c0c4813 2020-10-05T11:55:36.727 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.728+0000 7f110af110c0 20 RGWRados::pool_iterate: got zone_names.default 2020-10-05T11:55:36.727 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.728+0000 7f110af110c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-10-05T11:55:36.727 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.728+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.728 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.728+0000 7f110af110c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:36.728 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.728+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.729 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.728+0000 7f110af110c0 20 rados_obj.operate() r=0 bl.length=889 2020-10-05T11:55:36.729 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.728+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.730 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.732+0000 7f110af110c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:36.730 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.732+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.730 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.732+0000 7f110af110c0 20 rados_obj.operate() r=0 bl.length=358 2020-10-05T11:55:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.732+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.732+0000 7f110af110c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.732+0000 7f110af110c0 10 cannot find current period zonegroup using local zonegroup 2020-10-05T11:55:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.732+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.732 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.732+0000 7f110af110c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:36.732 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.732+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.732 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.732+0000 7f110af110c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.732+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.736+0000 7f110af110c0 20 rados_obj.operate() r=0 bl.length=358 2020-10-05T11:55:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.736+0000 7f110af110c0 20 zonegroup default 2020-10-05T11:55:36.734 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.736+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.734 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.736+0000 7f110af110c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:36.734 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.736+0000 7f110af110c0 10 Cannot find current period zone using local zone 2020-10-05T11:55:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.736+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.736+0000 7f110af110c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.736+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.736+0000 7f110af110c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:36.736 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.736+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.736 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.736+0000 7f110af110c0 20 rados_obj.operate() r=0 bl.length=889 2020-10-05T11:55:36.737 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.736+0000 7f110af110c0 20 zone default found 2020-10-05T11:55:36.737 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.736+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.737 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.740+0000 7f110af110c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:36.737 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.740+0000 7f110af110c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.740+0000 7f110af110c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.740+0000 7f110af110c0 20 started sync module instance, tier type = 2020-10-05T11:55:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.740+0000 7f110af110c0 20 started zone id=68f77b92-3d07-47cb-bbdb-76c00e31bdf8 (name=default) with tier type = 2020-10-05T11:55:36.766 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.768+0000 7f110af110c0 20 add_watcher() i=0 2020-10-05T11:55:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.768+0000 7f110af110c0 20 add_watcher() i=1 2020-10-05T11:55:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.768+0000 7f110af110c0 20 add_watcher() i=2 2020-10-05T11:55:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.768+0000 7f110af110c0 20 add_watcher() i=3 2020-10-05T11:55:36.767 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.768+0000 7f110af110c0 20 add_watcher() i=4 2020-10-05T11:55:36.768 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.768+0000 7f110af110c0 20 add_watcher() i=5 2020-10-05T11:55:36.768 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.768+0000 7f110af110c0 20 add_watcher() i=6 2020-10-05T11:55:36.769 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.768+0000 7f110af110c0 20 add_watcher() i=7 2020-10-05T11:55:36.769 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.768+0000 7f110af110c0 2 all 8 watchers are set, enabling cache 2020-10-05T11:55:36.788 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.788+0000 7f1043fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-10-05T11:55:36.789 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.788+0000 7f110af110c0 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-10-05T11:55:36.789 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.788+0000 7f110af110c0 20 check_secure_mon_conn(): mode 1 is insecure 2020-10-05T11:55:36.884 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.884+0000 7f1032ffd700 20 reqs_thread_entry: start 2020-10-05T11:55:36.885 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.884+0000 7f1030ff9700 20 reqs_thread_entry: start 2020-10-05T11:55:36.885 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.884+0000 7f110af110c0 20 init_complete bucket index max shards: 11 2020-10-05T11:55:36.885 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.884+0000 7f110af110c0 10 Started notification manager with: 1 workers 2020-10-05T11:55:36.885 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.884+0000 7f102affd700 20 INFO: next queues processing will happen at: Mon Oct 5 11:56:07 2020 2020-10-05T11:55:36.886 INFO:teuthology.orchestra.run.smithi081.stderr: 2020-10-05T11:55:36.886 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.884+0000 7f102a7fc700 20 reqs_thread_entry: start 2020-10-05T11:55:36.916 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2020-10-05T11:55:36.917 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.916+0000 7f110af110c0 20 remove_watcher() i=0 2020-10-05T11:55:36.917 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.916+0000 7f110af110c0 2 removed watcher, disabling cache 2020-10-05T11:55:36.920 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.920+0000 7f110af110c0 20 remove_watcher() i=1 2020-10-05T11:55:36.922 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.924+0000 7f110af110c0 20 remove_watcher() i=2 2020-10-05T11:55:36.925 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.928+0000 7f110af110c0 20 remove_watcher() i=3 2020-10-05T11:55:36.928 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.928+0000 7f110af110c0 20 remove_watcher() i=4 2020-10-05T11:55:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.932+0000 7f110af110c0 20 remove_watcher() i=5 2020-10-05T11:55:36.936 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.936+0000 7f110af110c0 20 remove_watcher() i=6 2020-10-05T11:55:36.938 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.940+0000 7f110af110c0 20 remove_watcher() i=7 2020-10-05T11:55:36.940 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:36.940+0000 7f1043fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-10-05T11:55:36.946 DEBUG:tasks.util.rgw: json result: [] 2020-10-05T11:55:36.947 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-10-05T11:55:36.947 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-10-05T11:55:36.947 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2020-10-05T11:55:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:37.036+0000 7f7f50cf80c0 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-10-05T11:55:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:37.036+0000 7f7f50cf80c0 20 check_secure_mon_conn(): mode 1 is insecure 2020-10-05T11:55:37.041 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:37.040+0000 7f7e867fc700 20 reqs_thread_entry: start 2020-10-05T11:55:37.041 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:37.040+0000 7f7f50cf80c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:37.042 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:37.044+0000 7f7f50cf80c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:37.043 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:37.044+0000 7f7f50cf80c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:37.044 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:37.044+0000 7f7f50cf80c0 20 rados_obj.operate() r=0 bl.length=889 2020-10-05T11:55:37.044 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:37.044+0000 7f7f50cf80c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:37.044+0000 7f7f50cf80c0 20 rados_obj.operate() r=-2 bl.length=0 2020-10-05T11:55:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:37.044+0000 7f7f50cf80c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:37.044+0000 7f7f50cf80c0 20 rados_obj.operate() r=0 bl.length=46 2020-10-05T11:55:37.045 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:37.044+0000 7f7f50cf80c0 20 rados->read ofs=0 len=0 2020-10-05T11:55:37.046 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:37.048+0000 7f7f50cf80c0 20 rados_obj.operate() r=0 bl.length=358 2020-10-05T11:55:37.054 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:55:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "68f77b92-3d07-47cb-bbdb-76c00e31bdf8", 2020-10-05T11:55:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default", 2020-10-05T11:55:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: "domain_root": "default.rgw.meta:root", 2020-10-05T11:55:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: "control_pool": "default.rgw.control", 2020-10-05T11:55:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: "gc_pool": "default.rgw.log:gc", 2020-10-05T11:55:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "lc_pool": "default.rgw.log:lc", 2020-10-05T11:55:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "log_pool": "default.rgw.log", 2020-10-05T11:55:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "intent_log_pool": "default.rgw.log:intent", 2020-10-05T11:55:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "usage_log_pool": "default.rgw.log:usage", 2020-10-05T11:55:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "roles_pool": "default.rgw.meta:roles", 2020-10-05T11:55:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "reshard_pool": "default.rgw.log:reshard", 2020-10-05T11:55:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2020-10-05T11:55:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "user_email_pool": "default.rgw.meta:users.email", 2020-10-05T11:55:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2020-10-05T11:55:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2020-10-05T11:55:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "otp_pool": "default.rgw.otp", 2020-10-05T11:55:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "system_key": { 2020-10-05T11:55:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "access_key": "", 2020-10-05T11:55:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "secret_key": "" 2020-10-05T11:55:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:55:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: "placement_pools": [ 2020-10-05T11:55:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:55:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "default-placement", 2020-10-05T11:55:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:55:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: "index_pool": "default.rgw.buckets.index", 2020-10-05T11:55:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_classes": { 2020-10-05T11:55:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "STANDARD": { 2020-10-05T11:55:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "data_pool": "default.rgw.buckets.data", 2020-10-05T11:55:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "compression_type": "random" 2020-10-05T11:55:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:55:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:55:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2020-10-05T11:55:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "index_type": 0 2020-10-05T11:55:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:55:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:55:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:55:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_id": "", 2020-10-05T11:55:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: "notif_pool": "default.rgw.log:notif" 2020-10-05T11:55:37.060 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:55:37.061 DEBUG:tasks.util.rgw: json result: {'id': '68f77b92-3d07-47cb-bbdb-76c00e31bdf8', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2020-10-05T11:55:37.061 INFO:tasks.rgw:Starting rgw... 2020-10-05T11:55:37.062 INFO:tasks.rgw:rgw c1.client.0 config is {'port': 8000} 2020-10-05T11:55:37.062 INFO:tasks.rgw:Using beast as radosgw frontend 2020-10-05T11:55:37.062 INFO:tasks.rgw.c1.client.0:Restarting daemon 2020-10-05T11:55:37.063 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2020-10-05T11:55:37.065 INFO:tasks.rgw.c1.client.0:Started 2020-10-05T11:55:37.066 INFO:tasks.rgw:rgw c1.client.1 config is {'port': 8001} 2020-10-05T11:55:37.066 INFO:tasks.rgw:Using beast as radosgw frontend 2020-10-05T11:55:37.066 INFO:tasks.rgw.c1.client.1:Restarting daemon 2020-10-05T11:55:37.067 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.1.stdout 2>&1 2020-10-05T11:55:37.069 INFO:tasks.rgw.c1.client.1:Started 2020-10-05T11:55:37.069 INFO:tasks.rgw:rgw c2.client.0 config is {'port': 8000} 2020-10-05T11:55:37.069 INFO:tasks.rgw:Using beast as radosgw frontend 2020-10-05T11:55:37.069 INFO:tasks.rgw.c2.client.0:Restarting daemon 2020-10-05T11:55:37.070 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2020-10-05T11:55:37.106 INFO:tasks.rgw.c2.client.0:Started 2020-10-05T11:55:37.106 INFO:tasks.rgw:rgw c2.client.1 config is {'port': 8001} 2020-10-05T11:55:37.107 INFO:tasks.rgw:Using beast as radosgw frontend 2020-10-05T11:55:37.107 INFO:tasks.rgw.c2.client.1:Restarting daemon 2020-10-05T11:55:37.107 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2020-10-05T11:55:37.109 INFO:tasks.rgw.c2.client.1:Started 2020-10-05T11:55:37.109 INFO:tasks.rgw:Polling c1.client.0 until it starts accepting connections on http://smithi158.front.sepia.ceph.com:8000/ 2020-10-05T11:55:37.110 INFO:teuthology.orchestra.run.smithi158:> curl http://smithi158.front.sepia.ceph.com:8000/ 2020-10-05T11:55:37.130 INFO:teuthology.orchestra.run.smithi158.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T11:55:37.130 INFO:teuthology.orchestra.run.smithi158.stderr: Dload Upload Total Spent Left Speed 2020-10-05T11:55:37.134 INFO:teuthology.orchestra.run.smithi158.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi158.front.sepia.ceph.com port 8000: Connection refused 2020-10-05T11:55:37.135 DEBUG:teuthology.orchestra.run:got remote process result: 7 2020-10-05T11:55:38.136 INFO:teuthology.orchestra.run.smithi158:> curl http://smithi158.front.sepia.ceph.com:8000/ 2020-10-05T11:55:38.149 INFO:teuthology.orchestra.run.smithi158.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T11:55:38.149 INFO:teuthology.orchestra.run.smithi158.stderr: Dload Upload Total Spent Left Speed 2020-10-05T11:55:38.154 INFO:teuthology.orchestra.run.smithi158.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 53500 2020-10-05T11:55:38.154 INFO:teuthology.orchestra.run.smithi158.stdout:anonymous 2020-10-05T11:55:38.155 INFO:tasks.rgw:Polling c1.client.1 until it starts accepting connections on http://smithi158.front.sepia.ceph.com:8001/ 2020-10-05T11:55:38.155 INFO:teuthology.orchestra.run.smithi158:> curl http://smithi158.front.sepia.ceph.com:8001/ 2020-10-05T11:55:38.212 INFO:teuthology.orchestra.run.smithi158.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T11:55:38.213 INFO:teuthology.orchestra.run.smithi158.stderr: Dload Upload Total Spent Left Speed 2020-10-05T11:55:38.217 INFO:teuthology.orchestra.run.smithi158.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 53500 2020-10-05T11:55:38.218 INFO:teuthology.orchestra.run.smithi158.stdout:anonymous 2020-10-05T11:55:38.218 INFO:tasks.rgw:Polling c2.client.0 until it starts accepting connections on http://smithi081.front.sepia.ceph.com:8000/ 2020-10-05T11:55:38.219 INFO:teuthology.orchestra.run.smithi081:> curl http://smithi081.front.sepia.ceph.com:8000/ 2020-10-05T11:55:38.236 INFO:teuthology.orchestra.run.smithi081.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T11:55:38.236 INFO:teuthology.orchestra.run.smithi081.stderr: Dload Upload Total Spent Left Speed 2020-10-05T11:55:38.241 INFO:teuthology.orchestra.run.smithi081.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 35666 0 --:--:-- --:--:-- --:--:-- 42800 2020-10-05T11:55:38.242 INFO:teuthology.orchestra.run.smithi081.stdout:anonymous 2020-10-05T11:55:38.242 INFO:tasks.rgw:Polling c2.client.1 until it starts accepting connections on http://smithi081.front.sepia.ceph.com:8001/ 2020-10-05T11:55:38.242 INFO:teuthology.orchestra.run.smithi081:> curl http://smithi081.front.sepia.ceph.com:8001/ 2020-10-05T11:55:38.301 INFO:teuthology.orchestra.run.smithi081.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T11:55:38.302 INFO:teuthology.orchestra.run.smithi081.stderr: Dload Upload Total Spent Left Speed 2020-10-05T11:55:38.305 INFO:teuthology.orchestra.run.smithi081.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2020-10-05T11:55:38.306 INFO:teuthology.orchestra.run.smithi081.stdout:anonymous 2020-10-05T11:55:38.307 INFO:teuthology.run_tasks:Running task rgw-multisite... 2020-10-05T11:55:38.671 INFO:tasks.rgw_multisite:creating realm.. 2020-10-05T11:55:38.672 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:38.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:38.673 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 realm create --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T11:55:38.711 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:38.711 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:38.760 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:55:38.760 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:55:38.760 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-realm", 2020-10-05T11:55:38.761 INFO:teuthology.orchestra.run.smithi158.stdout: "current_period": "cf4e1d87-58bf-4037-99d7-c49aa5e5087e", 2020-10-05T11:55:38.761 INFO:teuthology.orchestra.run.smithi158.stdout: "epoch": 1 2020-10-05T11:55:38.761 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:55:38.762 INFO:tasks.rgw_multisite:creating master zonegroup.. 2020-10-05T11:55:38.762 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:38.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:38.763 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup set --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T11:55:38.842 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:38.843 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:38.868 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:55:38.863+0000 7f542794d0c0 -1 old format 2020-10-05T11:55:38.883 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:55:38.884 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "test-zonegroup", 2020-10-05T11:55:38.884 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zonegroup", 2020-10-05T11:55:38.885 INFO:teuthology.orchestra.run.smithi158.stdout: "api_name": "", 2020-10-05T11:55:38.885 INFO:teuthology.orchestra.run.smithi158.stdout: "is_master": "true", 2020-10-05T11:55:38.885 INFO:teuthology.orchestra.run.smithi158.stdout: "endpoints": [ 2020-10-05T11:55:38.885 INFO:teuthology.orchestra.run.smithi158.stdout: "http://smithi158.front.sepia.ceph.com:8000" 2020-10-05T11:55:38.886 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:55:38.886 INFO:teuthology.orchestra.run.smithi158.stdout: "hostnames": [], 2020-10-05T11:55:38.886 INFO:teuthology.orchestra.run.smithi158.stdout: "hostnames_s3website": [], 2020-10-05T11:55:38.887 INFO:teuthology.orchestra.run.smithi158.stdout: "master_zone": "", 2020-10-05T11:55:38.887 INFO:teuthology.orchestra.run.smithi158.stdout: "zones": [], 2020-10-05T11:55:38.887 INFO:teuthology.orchestra.run.smithi158.stdout: "placement_targets": [], 2020-10-05T11:55:38.887 INFO:teuthology.orchestra.run.smithi158.stdout: "default_placement": "", 2020-10-05T11:55:38.888 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:55:38.888 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_policy": { 2020-10-05T11:55:38.888 INFO:teuthology.orchestra.run.smithi158.stdout: "groups": [] 2020-10-05T11:55:38.889 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:38.889 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:55:38.890 INFO:tasks.rgw_multisite:creating master zone.. 2020-10-05T11:55:38.891 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--endpoints', 'http://smithi158.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:38.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--endpoints', 'http://smithi158.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:38.892 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --master --access-key VXETEEL80ZIAZNTY --secret VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv --endpoints http://smithi158.front.sepia.ceph.com:8000 --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T11:55:38.978 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:38.979 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:39.052 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:55:39.052 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:55:39.053 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zone1", 2020-10-05T11:55:39.053 INFO:teuthology.orchestra.run.smithi158.stdout: "domain_root": "test-zone1.rgw.meta:root", 2020-10-05T11:55:39.053 INFO:teuthology.orchestra.run.smithi158.stdout: "control_pool": "test-zone1.rgw.control", 2020-10-05T11:55:39.053 INFO:teuthology.orchestra.run.smithi158.stdout: "gc_pool": "test-zone1.rgw.log:gc", 2020-10-05T11:55:39.053 INFO:teuthology.orchestra.run.smithi158.stdout: "lc_pool": "test-zone1.rgw.log:lc", 2020-10-05T11:55:39.054 INFO:teuthology.orchestra.run.smithi158.stdout: "log_pool": "test-zone1.rgw.log", 2020-10-05T11:55:39.054 INFO:teuthology.orchestra.run.smithi158.stdout: "intent_log_pool": "test-zone1.rgw.log:intent", 2020-10-05T11:55:39.054 INFO:teuthology.orchestra.run.smithi158.stdout: "usage_log_pool": "test-zone1.rgw.log:usage", 2020-10-05T11:55:39.054 INFO:teuthology.orchestra.run.smithi158.stdout: "roles_pool": "test-zone1.rgw.meta:roles", 2020-10-05T11:55:39.054 INFO:teuthology.orchestra.run.smithi158.stdout: "reshard_pool": "test-zone1.rgw.log:reshard", 2020-10-05T11:55:39.054 INFO:teuthology.orchestra.run.smithi158.stdout: "user_keys_pool": "test-zone1.rgw.meta:users.keys", 2020-10-05T11:55:39.055 INFO:teuthology.orchestra.run.smithi158.stdout: "user_email_pool": "test-zone1.rgw.meta:users.email", 2020-10-05T11:55:39.055 INFO:teuthology.orchestra.run.smithi158.stdout: "user_swift_pool": "test-zone1.rgw.meta:users.swift", 2020-10-05T11:55:39.055 INFO:teuthology.orchestra.run.smithi158.stdout: "user_uid_pool": "test-zone1.rgw.meta:users.uid", 2020-10-05T11:55:39.055 INFO:teuthology.orchestra.run.smithi158.stdout: "otp_pool": "test-zone1.rgw.otp", 2020-10-05T11:55:39.055 INFO:teuthology.orchestra.run.smithi158.stdout: "system_key": { 2020-10-05T11:55:39.055 INFO:teuthology.orchestra.run.smithi158.stdout: "access_key": "VXETEEL80ZIAZNTY", 2020-10-05T11:55:39.055 INFO:teuthology.orchestra.run.smithi158.stdout: "secret_key": "VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv" 2020-10-05T11:55:39.055 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:55:39.056 INFO:teuthology.orchestra.run.smithi158.stdout: "placement_pools": [ 2020-10-05T11:55:39.056 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:55:39.056 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "default-placement", 2020-10-05T11:55:39.056 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:55:39.056 INFO:teuthology.orchestra.run.smithi158.stdout: "index_pool": "test-zone1.rgw.buckets.index", 2020-10-05T11:55:39.056 INFO:teuthology.orchestra.run.smithi158.stdout: "storage_classes": { 2020-10-05T11:55:39.056 INFO:teuthology.orchestra.run.smithi158.stdout: "STANDARD": { 2020-10-05T11:55:39.057 INFO:teuthology.orchestra.run.smithi158.stdout: "data_pool": "test-zone1.rgw.buckets.data" 2020-10-05T11:55:39.057 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:39.057 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:55:39.057 INFO:teuthology.orchestra.run.smithi158.stdout: "data_extra_pool": "test-zone1.rgw.buckets.non-ec", 2020-10-05T11:55:39.057 INFO:teuthology.orchestra.run.smithi158.stdout: "index_type": 0 2020-10-05T11:55:39.057 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:39.057 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:39.058 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:55:39.058 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:55:39.058 INFO:teuthology.orchestra.run.smithi158.stdout: "notif_pool": "test-zone1.rgw.log:notif" 2020-10-05T11:55:39.058 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:55:39.059 INFO:teuthology.orchestra.run.smithi158:> sudo ceph osd pool create test-zone1.rgw.buckets.data 64 64 --cluster c1 2020-10-05T11:55:40.204 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'test-zone1.rgw.buckets.data' created 2020-10-05T11:55:40.228 INFO:teuthology.orchestra.run.smithi158:> sudo ceph osd pool application enable test-zone1.rgw.buckets.data rgw --cluster c1 2020-10-05T11:55:41.224 INFO:teuthology.orchestra.run.smithi158.stderr:enabled application 'rgw' on pool 'test-zone1.rgw.buckets.data' 2020-10-05T11:55:41.243 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:41.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:41.244 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T11:55:41.295 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:41.296 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:41.316 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:55:41.316 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:55:41.316 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zone1", 2020-10-05T11:55:41.316 INFO:teuthology.orchestra.run.smithi158.stdout: "domain_root": "test-zone1.rgw.meta:root", 2020-10-05T11:55:41.316 INFO:teuthology.orchestra.run.smithi158.stdout: "control_pool": "test-zone1.rgw.control", 2020-10-05T11:55:41.317 INFO:teuthology.orchestra.run.smithi158.stdout: "gc_pool": "test-zone1.rgw.log:gc", 2020-10-05T11:55:41.317 INFO:teuthology.orchestra.run.smithi158.stdout: "lc_pool": "test-zone1.rgw.log:lc", 2020-10-05T11:55:41.317 INFO:teuthology.orchestra.run.smithi158.stdout: "log_pool": "test-zone1.rgw.log", 2020-10-05T11:55:41.317 INFO:teuthology.orchestra.run.smithi158.stdout: "intent_log_pool": "test-zone1.rgw.log:intent", 2020-10-05T11:55:41.317 INFO:teuthology.orchestra.run.smithi158.stdout: "usage_log_pool": "test-zone1.rgw.log:usage", 2020-10-05T11:55:41.317 INFO:teuthology.orchestra.run.smithi158.stdout: "roles_pool": "test-zone1.rgw.meta:roles", 2020-10-05T11:55:41.317 INFO:teuthology.orchestra.run.smithi158.stdout: "reshard_pool": "test-zone1.rgw.log:reshard", 2020-10-05T11:55:41.317 INFO:teuthology.orchestra.run.smithi158.stdout: "user_keys_pool": "test-zone1.rgw.meta:users.keys", 2020-10-05T11:55:41.318 INFO:teuthology.orchestra.run.smithi158.stdout: "user_email_pool": "test-zone1.rgw.meta:users.email", 2020-10-05T11:55:41.318 INFO:teuthology.orchestra.run.smithi158.stdout: "user_swift_pool": "test-zone1.rgw.meta:users.swift", 2020-10-05T11:55:41.318 INFO:teuthology.orchestra.run.smithi158.stdout: "user_uid_pool": "test-zone1.rgw.meta:users.uid", 2020-10-05T11:55:41.318 INFO:teuthology.orchestra.run.smithi158.stdout: "otp_pool": "test-zone1.rgw.otp", 2020-10-05T11:55:41.318 INFO:teuthology.orchestra.run.smithi158.stdout: "system_key": { 2020-10-05T11:55:41.318 INFO:teuthology.orchestra.run.smithi158.stdout: "access_key": "VXETEEL80ZIAZNTY", 2020-10-05T11:55:41.319 INFO:teuthology.orchestra.run.smithi158.stdout: "secret_key": "VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv" 2020-10-05T11:55:41.319 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:55:41.319 INFO:teuthology.orchestra.run.smithi158.stdout: "placement_pools": [ 2020-10-05T11:55:41.319 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:55:41.319 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "default-placement", 2020-10-05T11:55:41.319 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:55:41.319 INFO:teuthology.orchestra.run.smithi158.stdout: "index_pool": "test-zone1.rgw.buckets.index", 2020-10-05T11:55:41.319 INFO:teuthology.orchestra.run.smithi158.stdout: "storage_classes": { 2020-10-05T11:55:41.320 INFO:teuthology.orchestra.run.smithi158.stdout: "STANDARD": { 2020-10-05T11:55:41.320 INFO:teuthology.orchestra.run.smithi158.stdout: "data_pool": "test-zone1.rgw.buckets.data", 2020-10-05T11:55:41.320 INFO:teuthology.orchestra.run.smithi158.stdout: "compression_type": "random" 2020-10-05T11:55:41.320 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:41.320 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:55:41.320 INFO:teuthology.orchestra.run.smithi158.stdout: "data_extra_pool": "test-zone1.rgw.buckets.non-ec", 2020-10-05T11:55:41.320 INFO:teuthology.orchestra.run.smithi158.stdout: "index_type": 0 2020-10-05T11:55:41.321 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:41.321 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:41.321 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:55:41.321 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_id": "", 2020-10-05T11:55:41.321 INFO:teuthology.orchestra.run.smithi158.stdout: "notif_pool": "test-zone1.rgw.log:notif" 2020-10-05T11:55:41.321 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:55:41.322 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:41.323 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:41.323 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T11:55:41.357 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:41.358 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:49.496 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:55:49.496 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:55:49.496 INFO:teuthology.orchestra.run.smithi158.stdout: "epoch": 1, 2020-10-05T11:55:49.496 INFO:teuthology.orchestra.run.smithi158.stdout: "predecessor_uuid": "cf4e1d87-58bf-4037-99d7-c49aa5e5087e", 2020-10-05T11:55:49.497 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": [], 2020-10-05T11:55:49.497 INFO:teuthology.orchestra.run.smithi158.stdout: "period_map": { 2020-10-05T11:55:49.497 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:55:49.497 INFO:teuthology.orchestra.run.smithi158.stdout: "zonegroups": [ 2020-10-05T11:55:49.497 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:55:49.497 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "test-zonegroup", 2020-10-05T11:55:49.497 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zonegroup", 2020-10-05T11:55:49.498 INFO:teuthology.orchestra.run.smithi158.stdout: "api_name": "", 2020-10-05T11:55:49.498 INFO:teuthology.orchestra.run.smithi158.stdout: "is_master": "true", 2020-10-05T11:55:49.498 INFO:teuthology.orchestra.run.smithi158.stdout: "endpoints": [ 2020-10-05T11:55:49.498 INFO:teuthology.orchestra.run.smithi158.stdout: "http://smithi158.front.sepia.ceph.com:8000" 2020-10-05T11:55:49.498 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:55:49.498 INFO:teuthology.orchestra.run.smithi158.stdout: "hostnames": [], 2020-10-05T11:55:49.498 INFO:teuthology.orchestra.run.smithi158.stdout: "hostnames_s3website": [], 2020-10-05T11:55:49.499 INFO:teuthology.orchestra.run.smithi158.stdout: "master_zone": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:55:49.499 INFO:teuthology.orchestra.run.smithi158.stdout: "zones": [ 2020-10-05T11:55:49.499 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:55:49.499 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:55:49.499 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zone1", 2020-10-05T11:55:49.499 INFO:teuthology.orchestra.run.smithi158.stdout: "endpoints": [ 2020-10-05T11:55:49.499 INFO:teuthology.orchestra.run.smithi158.stdout: "http://smithi158.front.sepia.ceph.com:8000" 2020-10-05T11:55:49.500 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:55:49.500 INFO:teuthology.orchestra.run.smithi158.stdout: "log_meta": "false", 2020-10-05T11:55:49.500 INFO:teuthology.orchestra.run.smithi158.stdout: "log_data": "false", 2020-10-05T11:55:49.500 INFO:teuthology.orchestra.run.smithi158.stdout: "bucket_index_max_shards": 11, 2020-10-05T11:55:49.500 INFO:teuthology.orchestra.run.smithi158.stdout: "read_only": "false", 2020-10-05T11:55:49.500 INFO:teuthology.orchestra.run.smithi158.stdout: "tier_type": "", 2020-10-05T11:55:49.500 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from_all": "true", 2020-10-05T11:55:49.501 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from": [], 2020-10-05T11:55:49.501 INFO:teuthology.orchestra.run.smithi158.stdout: "redirect_zone": "" 2020-10-05T11:55:49.501 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:49.501 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:55:49.501 INFO:teuthology.orchestra.run.smithi158.stdout: "placement_targets": [ 2020-10-05T11:55:49.501 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:55:49.501 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "default-placement", 2020-10-05T11:55:49.502 INFO:teuthology.orchestra.run.smithi158.stdout: "tags": [], 2020-10-05T11:55:49.502 INFO:teuthology.orchestra.run.smithi158.stdout: "storage_classes": [ 2020-10-05T11:55:49.502 INFO:teuthology.orchestra.run.smithi158.stdout: "STANDARD" 2020-10-05T11:55:49.502 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T11:55:49.502 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:49.502 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:55:49.502 INFO:teuthology.orchestra.run.smithi158.stdout: "default_placement": "default-placement", 2020-10-05T11:55:49.503 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:55:49.503 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_policy": { 2020-10-05T11:55:49.503 INFO:teuthology.orchestra.run.smithi158.stdout: "groups": [] 2020-10-05T11:55:49.503 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:49.503 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:49.503 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:55:49.503 INFO:teuthology.orchestra.run.smithi158.stdout: "short_zone_ids": [ 2020-10-05T11:55:49.504 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:55:49.504 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:55:49.504 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 3324834999 2020-10-05T11:55:49.504 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:49.504 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T11:55:49.504 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:55:49.504 INFO:teuthology.orchestra.run.smithi158.stdout: "master_zonegroup": "test-zonegroup", 2020-10-05T11:55:49.504 INFO:teuthology.orchestra.run.smithi158.stdout: "master_zone": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:55:49.505 INFO:teuthology.orchestra.run.smithi158.stdout: "period_config": { 2020-10-05T11:55:49.505 INFO:teuthology.orchestra.run.smithi158.stdout: "bucket_quota": { 2020-10-05T11:55:49.505 INFO:teuthology.orchestra.run.smithi158.stdout: "enabled": false, 2020-10-05T11:55:49.505 INFO:teuthology.orchestra.run.smithi158.stdout: "check_on_raw": false, 2020-10-05T11:55:49.505 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size": -1, 2020-10-05T11:55:49.505 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size_kb": 0, 2020-10-05T11:55:49.506 INFO:teuthology.orchestra.run.smithi158.stdout: "max_objects": -1 2020-10-05T11:55:49.506 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:55:49.506 INFO:teuthology.orchestra.run.smithi158.stdout: "user_quota": { 2020-10-05T11:55:49.506 INFO:teuthology.orchestra.run.smithi158.stdout: "enabled": false, 2020-10-05T11:55:49.506 INFO:teuthology.orchestra.run.smithi158.stdout: "check_on_raw": false, 2020-10-05T11:55:49.506 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size": -1, 2020-10-05T11:55:49.506 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size_kb": 0, 2020-10-05T11:55:49.507 INFO:teuthology.orchestra.run.smithi158.stdout: "max_objects": -1 2020-10-05T11:55:49.507 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:49.507 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:55:49.507 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:55:49.507 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_name": "test-realm", 2020-10-05T11:55:49.507 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:55:49.507 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:55:49.508 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2020-10-05T11:55:49.509 INFO:teuthology.orchestra.run:waiting for 300 2020-10-05T11:55:49.553 INFO:tasks.rgw.c1.client.0.smithi158.stdout:2020-10-05T11:55:49.551+0000 7f49f2505700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground (PID: 14120) UID: 0 2020-10-05T11:55:49.553 INFO:tasks.rgw.c1.client.0.smithi158.stdout:2020-10-05T11:55:49.551+0000 7f4a09c69100 -1 shutting down 2020-10-05T11:55:53.856 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 is failed for ~0s 2020-10-05T11:55:55.611 INFO:tasks.rgw.c1.client.0:Stopped 2020-10-05T11:55:55.612 INFO:tasks.rgw.c1.client.0:Restarting daemon 2020-10-05T11:55:55.612 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2020-10-05T11:55:55.614 INFO:tasks.rgw.c1.client.0:Started 2020-10-05T11:55:55.615 INFO:teuthology.orchestra.run.smithi158:> curl http://smithi158.front.sepia.ceph.com:8000 2020-10-05T11:55:55.631 INFO:teuthology.orchestra.run.smithi158.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T11:55:55.632 INFO:teuthology.orchestra.run.smithi158.stderr: Dload Upload Total Spent Left Speed 2020-10-05T11:55:55.635 INFO:teuthology.orchestra.run.smithi158.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi158.front.sepia.ceph.com port 8000: Connection refused 2020-10-05T11:55:55.636 DEBUG:teuthology.orchestra.run:got remote process result: 7 2020-10-05T11:55:56.637 INFO:teuthology.orchestra.run.smithi158:> curl http://smithi158.front.sepia.ceph.com:8000 2020-10-05T11:55:56.651 INFO:teuthology.orchestra.run.smithi158.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T11:55:56.651 INFO:teuthology.orchestra.run.smithi158.stderr: Dload Upload Total Spent Left Speed 2020-10-05T11:55:56.655 INFO:teuthology.orchestra.run.smithi158.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2020-10-05T11:55:56.656 INFO:teuthology.orchestra.run.smithi158.stdout:anonymous 2020-10-05T11:55:56.657 INFO:tasks.rgw_multisite:creating admin user.. 2020-10-05T11:55:56.657 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:56.657 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:56.658 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid realm-admin --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Realm Admin' --system --access-key VXETEEL80ZIAZNTY --secret VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T11:55:56.747 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:56.747 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:56.962 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:55:56.963 INFO:teuthology.orchestra.run.smithi158.stdout: "user_id": "realm-admin", 2020-10-05T11:55:56.963 INFO:teuthology.orchestra.run.smithi158.stdout: "display_name": "Realm Admin", 2020-10-05T11:55:56.963 INFO:teuthology.orchestra.run.smithi158.stdout: "email": "", 2020-10-05T11:55:56.963 INFO:teuthology.orchestra.run.smithi158.stdout: "suspended": 0, 2020-10-05T11:55:56.963 INFO:teuthology.orchestra.run.smithi158.stdout: "max_buckets": 1000, 2020-10-05T11:55:56.963 INFO:teuthology.orchestra.run.smithi158.stdout: "subusers": [], 2020-10-05T11:55:56.964 INFO:teuthology.orchestra.run.smithi158.stdout: "keys": [ 2020-10-05T11:55:56.964 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:55:56.964 INFO:teuthology.orchestra.run.smithi158.stdout: "user": "realm-admin", 2020-10-05T11:55:56.964 INFO:teuthology.orchestra.run.smithi158.stdout: "access_key": "VXETEEL80ZIAZNTY", 2020-10-05T11:55:56.964 INFO:teuthology.orchestra.run.smithi158.stdout: "secret_key": "VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv" 2020-10-05T11:55:56.964 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:55:56.964 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:55:56.965 INFO:teuthology.orchestra.run.smithi158.stdout: "swift_keys": [], 2020-10-05T11:55:56.965 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": [], 2020-10-05T11:55:56.965 INFO:teuthology.orchestra.run.smithi158.stdout: "op_mask": "read, write, delete", 2020-10-05T11:55:56.965 INFO:teuthology.orchestra.run.smithi158.stdout: "system": "true", 2020-10-05T11:55:56.965 INFO:teuthology.orchestra.run.smithi158.stdout: "default_placement": "", 2020-10-05T11:55:56.965 INFO:teuthology.orchestra.run.smithi158.stdout: "default_storage_class": "", 2020-10-05T11:55:56.965 INFO:teuthology.orchestra.run.smithi158.stdout: "placement_tags": [], 2020-10-05T11:55:56.966 INFO:teuthology.orchestra.run.smithi158.stdout: "bucket_quota": { 2020-10-05T11:55:56.966 INFO:teuthology.orchestra.run.smithi158.stdout: "enabled": false, 2020-10-05T11:55:56.966 INFO:teuthology.orchestra.run.smithi158.stdout: "check_on_raw": false, 2020-10-05T11:55:56.966 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size": -1, 2020-10-05T11:55:56.966 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size_kb": 0, 2020-10-05T11:55:56.966 INFO:teuthology.orchestra.run.smithi158.stdout: "max_objects": -1 2020-10-05T11:55:56.967 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:55:56.967 INFO:teuthology.orchestra.run.smithi158.stdout: "user_quota": { 2020-10-05T11:55:56.967 INFO:teuthology.orchestra.run.smithi158.stdout: "enabled": false, 2020-10-05T11:55:56.967 INFO:teuthology.orchestra.run.smithi158.stdout: "check_on_raw": false, 2020-10-05T11:55:56.967 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size": -1, 2020-10-05T11:55:56.967 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size_kb": 0, 2020-10-05T11:55:56.967 INFO:teuthology.orchestra.run.smithi158.stdout: "max_objects": -1 2020-10-05T11:55:56.968 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:55:56.968 INFO:teuthology.orchestra.run.smithi158.stdout: "temp_url_keys": [], 2020-10-05T11:55:56.968 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "rgw", 2020-10-05T11:55:56.968 INFO:teuthology.orchestra.run.smithi158.stdout: "mfa_ids": [] 2020-10-05T11:55:56.968 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:55:56.968 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:55:56.991 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2020-10-05T11:55:56.992 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi158.front.sepia.ceph.com:8000', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:56.992 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi158.front.sepia.ceph.com:8000', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:56.992 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi158.front.sepia.ceph.com:8000 --access-key VXETEEL80ZIAZNTY --secret VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv --cluster c2 --debug-rgw 0 --debug-ms 0 2020-10-05T11:55:57.036 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:57.037 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:57.157 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:55:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:55:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-realm", 2020-10-05T11:55:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "current_period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:55:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 2 2020-10-05T11:55:57.159 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:55:57.160 INFO:tasks.rgw_multisite:creating zone.. 2020-10-05T11:55:57.160 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--endpoints', 'http://smithi081.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:57.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--endpoints', 'http://smithi081.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:57.161 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --access-key VXETEEL80ZIAZNTY --secret VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv --endpoints http://smithi081.front.sepia.ceph.com:8000 --cluster c2 --debug-rgw 0 --debug-ms 0 2020-10-05T11:55:57.243 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:57.243 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:57.309 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:57.308+0000 7f64c31590c0 0 failed reading obj info from .rgw.root:zone_info.35a06950-5b24-42ca-86ff-3dc913eb1ccc: (2) No such file or directory 2020-10-05T11:55:57.310 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:55:57.308+0000 7f64c31590c0 0 WARNING: could not read zone params for zone id=35a06950-5b24-42ca-86ff-3dc913eb1ccc name=test-zone1 2020-10-05T11:55:57.322 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:55:57.322 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T11:55:57.322 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone2", 2020-10-05T11:55:57.323 INFO:teuthology.orchestra.run.smithi081.stdout: "domain_root": "test-zone2.rgw.meta:root", 2020-10-05T11:55:57.323 INFO:teuthology.orchestra.run.smithi081.stdout: "control_pool": "test-zone2.rgw.control", 2020-10-05T11:55:57.323 INFO:teuthology.orchestra.run.smithi081.stdout: "gc_pool": "test-zone2.rgw.log:gc", 2020-10-05T11:55:57.323 INFO:teuthology.orchestra.run.smithi081.stdout: "lc_pool": "test-zone2.rgw.log:lc", 2020-10-05T11:55:57.324 INFO:teuthology.orchestra.run.smithi081.stdout: "log_pool": "test-zone2.rgw.log", 2020-10-05T11:55:57.324 INFO:teuthology.orchestra.run.smithi081.stdout: "intent_log_pool": "test-zone2.rgw.log:intent", 2020-10-05T11:55:57.324 INFO:teuthology.orchestra.run.smithi081.stdout: "usage_log_pool": "test-zone2.rgw.log:usage", 2020-10-05T11:55:57.324 INFO:teuthology.orchestra.run.smithi081.stdout: "roles_pool": "test-zone2.rgw.meta:roles", 2020-10-05T11:55:57.324 INFO:teuthology.orchestra.run.smithi081.stdout: "reshard_pool": "test-zone2.rgw.log:reshard", 2020-10-05T11:55:57.324 INFO:teuthology.orchestra.run.smithi081.stdout: "user_keys_pool": "test-zone2.rgw.meta:users.keys", 2020-10-05T11:55:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "user_email_pool": "test-zone2.rgw.meta:users.email", 2020-10-05T11:55:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "user_swift_pool": "test-zone2.rgw.meta:users.swift", 2020-10-05T11:55:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "user_uid_pool": "test-zone2.rgw.meta:users.uid", 2020-10-05T11:55:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "otp_pool": "test-zone2.rgw.otp", 2020-10-05T11:55:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "system_key": { 2020-10-05T11:55:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "access_key": "VXETEEL80ZIAZNTY", 2020-10-05T11:55:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "secret_key": "VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv" 2020-10-05T11:55:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:55:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "placement_pools": [ 2020-10-05T11:55:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:55:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "default-placement", 2020-10-05T11:55:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:55:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "index_pool": "test-zone2.rgw.buckets.index", 2020-10-05T11:55:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_classes": { 2020-10-05T11:55:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "STANDARD": { 2020-10-05T11:55:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "data_pool": "test-zone2.rgw.buckets.data" 2020-10-05T11:55:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:55:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:55:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "data_extra_pool": "test-zone2.rgw.buckets.non-ec", 2020-10-05T11:55:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "index_type": 0 2020-10-05T11:55:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:55:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:55:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:55:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:55:57.328 INFO:teuthology.orchestra.run.smithi081.stdout: "notif_pool": "test-zone2.rgw.log:notif" 2020-10-05T11:55:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:55:57.329 INFO:teuthology.orchestra.run.smithi081:> sudo ceph osd pool create test-zone2.rgw.buckets.data 64 64 --cluster c2 2020-10-05T11:55:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'test-zone2.rgw.buckets.data' created 2020-10-05T11:55:58.590 INFO:teuthology.orchestra.run.smithi081:> sudo ceph osd pool application enable test-zone2.rgw.buckets.data rgw --cluster c2 2020-10-05T11:55:59.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 has been restored 2020-10-05T11:55:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:enabled application 'rgw' on pool 'test-zone2.rgw.buckets.data' 2020-10-05T11:55:59.612 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:59.613 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:59.613 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2020-10-05T11:55:59.652 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:55:59.676 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:55:59.676 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T11:55:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone2", 2020-10-05T11:55:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "domain_root": "test-zone2.rgw.meta:root", 2020-10-05T11:55:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "control_pool": "test-zone2.rgw.control", 2020-10-05T11:55:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "gc_pool": "test-zone2.rgw.log:gc", 2020-10-05T11:55:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "lc_pool": "test-zone2.rgw.log:lc", 2020-10-05T11:55:59.677 INFO:teuthology.orchestra.run.smithi081.stdout: "log_pool": "test-zone2.rgw.log", 2020-10-05T11:55:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "intent_log_pool": "test-zone2.rgw.log:intent", 2020-10-05T11:55:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "usage_log_pool": "test-zone2.rgw.log:usage", 2020-10-05T11:55:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "roles_pool": "test-zone2.rgw.meta:roles", 2020-10-05T11:55:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "reshard_pool": "test-zone2.rgw.log:reshard", 2020-10-05T11:55:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "user_keys_pool": "test-zone2.rgw.meta:users.keys", 2020-10-05T11:55:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "user_email_pool": "test-zone2.rgw.meta:users.email", 2020-10-05T11:55:59.678 INFO:teuthology.orchestra.run.smithi081.stdout: "user_swift_pool": "test-zone2.rgw.meta:users.swift", 2020-10-05T11:55:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: "user_uid_pool": "test-zone2.rgw.meta:users.uid", 2020-10-05T11:55:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: "otp_pool": "test-zone2.rgw.otp", 2020-10-05T11:55:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: "system_key": { 2020-10-05T11:55:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: "access_key": "VXETEEL80ZIAZNTY", 2020-10-05T11:55:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: "secret_key": "VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv" 2020-10-05T11:55:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:55:59.679 INFO:teuthology.orchestra.run.smithi081.stdout: "placement_pools": [ 2020-10-05T11:55:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:55:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "default-placement", 2020-10-05T11:55:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:55:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "index_pool": "test-zone2.rgw.buckets.index", 2020-10-05T11:55:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_classes": { 2020-10-05T11:55:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "STANDARD": { 2020-10-05T11:55:59.680 INFO:teuthology.orchestra.run.smithi081.stdout: "data_pool": "test-zone2.rgw.buckets.data", 2020-10-05T11:55:59.681 INFO:teuthology.orchestra.run.smithi081.stdout: "compression_type": "random" 2020-10-05T11:55:59.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:55:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:55:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: "data_extra_pool": "test-zone2.rgw.buckets.non-ec", 2020-10-05T11:55:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: "index_type": 0 2020-10-05T11:55:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:55:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:55:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:55:59.682 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_id": "", 2020-10-05T11:55:59.683 INFO:teuthology.orchestra.run.smithi081.stdout: "notif_pool": "test-zone2.rgw.log:notif" 2020-10-05T11:55:59.683 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:55:59.684 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:59.684 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:55:59.684 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2020-10-05T11:55:59.759 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:55:59.760 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:56:07.779 INFO:teuthology.orchestra.run.smithi081.stderr:Sending period to new master zone 35a06950-5b24-42ca-86ff-3dc913eb1ccc 2020-10-05T11:56:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:56:07.875 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:56:07.876 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 2, 2020-10-05T11:56:07.876 INFO:teuthology.orchestra.run.smithi081.stdout: "predecessor_uuid": "cf4e1d87-58bf-4037-99d7-c49aa5e5087e", 2020-10-05T11:56:07.876 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": [], 2020-10-05T11:56:07.877 INFO:teuthology.orchestra.run.smithi081.stdout: "period_map": { 2020-10-05T11:56:07.877 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:56:07.877 INFO:teuthology.orchestra.run.smithi081.stdout: "zonegroups": [ 2020-10-05T11:56:07.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:07.878 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "test-zonegroup", 2020-10-05T11:56:07.878 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zonegroup", 2020-10-05T11:56:07.878 INFO:teuthology.orchestra.run.smithi081.stdout: "api_name": "", 2020-10-05T11:56:07.878 INFO:teuthology.orchestra.run.smithi081.stdout: "is_master": "true", 2020-10-05T11:56:07.879 INFO:teuthology.orchestra.run.smithi081.stdout: "endpoints": [ 2020-10-05T11:56:07.879 INFO:teuthology.orchestra.run.smithi081.stdout: "http://smithi158.front.sepia.ceph.com:8000" 2020-10-05T11:56:07.879 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:07.880 INFO:teuthology.orchestra.run.smithi081.stdout: "hostnames": [], 2020-10-05T11:56:07.880 INFO:teuthology.orchestra.run.smithi081.stdout: "hostnames_s3website": [], 2020-10-05T11:56:07.880 INFO:teuthology.orchestra.run.smithi081.stdout: "master_zone": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:56:07.880 INFO:teuthology.orchestra.run.smithi081.stdout: "zones": [ 2020-10-05T11:56:07.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:07.881 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:56:07.881 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone1", 2020-10-05T11:56:07.881 INFO:teuthology.orchestra.run.smithi081.stdout: "endpoints": [ 2020-10-05T11:56:07.882 INFO:teuthology.orchestra.run.smithi081.stdout: "http://smithi158.front.sepia.ceph.com:8000" 2020-10-05T11:56:07.882 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:07.882 INFO:teuthology.orchestra.run.smithi081.stdout: "log_meta": "false", 2020-10-05T11:56:07.883 INFO:teuthology.orchestra.run.smithi081.stdout: "log_data": "true", 2020-10-05T11:56:07.883 INFO:teuthology.orchestra.run.smithi081.stdout: "bucket_index_max_shards": 11, 2020-10-05T11:56:07.883 INFO:teuthology.orchestra.run.smithi081.stdout: "read_only": "false", 2020-10-05T11:56:07.883 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_type": "", 2020-10-05T11:56:07.884 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from_all": "true", 2020-10-05T11:56:07.884 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from": [], 2020-10-05T11:56:07.884 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_zone": "" 2020-10-05T11:56:07.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:07.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:07.885 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T11:56:07.885 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone2", 2020-10-05T11:56:07.886 INFO:teuthology.orchestra.run.smithi081.stdout: "endpoints": [ 2020-10-05T11:56:07.886 INFO:teuthology.orchestra.run.smithi081.stdout: "http://smithi081.front.sepia.ceph.com:8000" 2020-10-05T11:56:07.886 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:07.886 INFO:teuthology.orchestra.run.smithi081.stdout: "log_meta": "false", 2020-10-05T11:56:07.887 INFO:teuthology.orchestra.run.smithi081.stdout: "log_data": "true", 2020-10-05T11:56:07.887 INFO:teuthology.orchestra.run.smithi081.stdout: "bucket_index_max_shards": 11, 2020-10-05T11:56:07.887 INFO:teuthology.orchestra.run.smithi081.stdout: "read_only": "false", 2020-10-05T11:56:07.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_type": "", 2020-10-05T11:56:07.888 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from_all": "true", 2020-10-05T11:56:07.888 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from": [], 2020-10-05T11:56:07.888 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_zone": "" 2020-10-05T11:56:07.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:07.889 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:07.889 INFO:teuthology.orchestra.run.smithi081.stdout: "placement_targets": [ 2020-10-05T11:56:07.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default-placement", 2020-10-05T11:56:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2020-10-05T11:56:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_classes": [ 2020-10-05T11:56:07.891 INFO:teuthology.orchestra.run.smithi081.stdout: "STANDARD" 2020-10-05T11:56:07.891 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:56:07.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:07.891 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:07.892 INFO:teuthology.orchestra.run.smithi081.stdout: "default_placement": "default-placement", 2020-10-05T11:56:07.892 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:56:07.892 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_policy": { 2020-10-05T11:56:07.892 INFO:teuthology.orchestra.run.smithi081.stdout: "groups": [] 2020-10-05T11:56:07.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:07.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:07.893 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:07.893 INFO:teuthology.orchestra.run.smithi081.stdout: "short_zone_ids": [ 2020-10-05T11:56:07.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:07.894 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:56:07.894 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 3324834999 2020-10-05T11:56:07.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:07.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:07.895 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T11:56:07.895 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 4213498805 2020-10-05T11:56:07.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:07.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:56:07.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:07.897 INFO:teuthology.orchestra.run.smithi081.stdout: "master_zonegroup": "test-zonegroup", 2020-10-05T11:56:07.897 INFO:teuthology.orchestra.run.smithi081.stdout: "master_zone": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:56:07.897 INFO:teuthology.orchestra.run.smithi081.stdout: "period_config": { 2020-10-05T11:56:07.897 INFO:teuthology.orchestra.run.smithi081.stdout: "bucket_quota": { 2020-10-05T11:56:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": false, 2020-10-05T11:56:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: "check_on_raw": false, 2020-10-05T11:56:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: "max_size": -1, 2020-10-05T11:56:07.898 INFO:teuthology.orchestra.run.smithi081.stdout: "max_size_kb": 0, 2020-10-05T11:56:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: "max_objects": -1 2020-10-05T11:56:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:07.899 INFO:teuthology.orchestra.run.smithi081.stdout: "user_quota": { 2020-10-05T11:56:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": false, 2020-10-05T11:56:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: "check_on_raw": false, 2020-10-05T11:56:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: "max_size": -1, 2020-10-05T11:56:07.900 INFO:teuthology.orchestra.run.smithi081.stdout: "max_size_kb": 0, 2020-10-05T11:56:07.901 INFO:teuthology.orchestra.run.smithi081.stdout: "max_objects": -1 2020-10-05T11:56:07.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:07.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:07.901 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:56:07.902 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_name": "test-realm", 2020-10-05T11:56:07.902 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:56:07.902 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:56:07.904 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2020-10-05T11:56:07.905 INFO:teuthology.orchestra.run:waiting for 300 2020-10-05T11:56:07.945 INFO:tasks.rgw.c2.client.0.smithi081.stdout:2020-10-05T11:56:07.944+0000 7f986effd700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground (PID: 14326) UID: 0 2020-10-05T11:56:07.946 INFO:tasks.rgw.c2.client.0.smithi081.stdout:2020-10-05T11:56:07.944+0000 7f98927af100 -1 shutting down 2020-10-05T11:56:10.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2020-10-05T11:56:14.006 INFO:tasks.rgw.c2.client.0:Stopped 2020-10-05T11:56:14.007 INFO:tasks.rgw.c2.client.0:Restarting daemon 2020-10-05T11:56:14.007 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2020-10-05T11:56:14.010 INFO:tasks.rgw.c2.client.0:Started 2020-10-05T11:56:14.010 INFO:teuthology.orchestra.run.smithi081:> curl http://smithi081.front.sepia.ceph.com:8000 2020-10-05T11:56:14.025 INFO:teuthology.orchestra.run.smithi081.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T11:56:14.025 INFO:teuthology.orchestra.run.smithi081.stderr: Dload Upload Total Spent Left Speed 2020-10-05T11:56:14.029 INFO:teuthology.orchestra.run.smithi081.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi081.front.sepia.ceph.com port 8000: Connection refused 2020-10-05T11:56:14.030 DEBUG:teuthology.orchestra.run:got remote process result: 7 2020-10-05T11:56:15.031 INFO:teuthology.orchestra.run.smithi081:> curl http://smithi081.front.sepia.ceph.com:8000 2020-10-05T11:56:15.047 INFO:teuthology.orchestra.run.smithi081.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T11:56:15.047 INFO:teuthology.orchestra.run.smithi081.stderr: Dload Upload Total Spent Left Speed 2020-10-05T11:56:15.052 INFO:teuthology.orchestra.run.smithi081.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 53500 2020-10-05T11:56:15.052 INFO:teuthology.orchestra.run.smithi081.stdout:anonymous 2020-10-05T11:56:15.053 INFO:tasks.rgw_multisite:creating zone.. 2020-10-05T11:56:15.053 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--endpoints', 'http://smithi158.front.sepia.ceph.com:8001', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:15.053 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--endpoints', 'http://smithi158.front.sepia.ceph.com:8001', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:15.054 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key VXETEEL80ZIAZNTY --secret VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv --endpoints http://smithi158.front.sepia.ceph.com:8001 --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T11:56:15.098 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:56:15.099 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:56:15.163 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:56:15.159+0000 7f17b69860c0 0 failed reading obj info from .rgw.root:zone_info.bdf35e5b-c653-4ef8-994d-7961e459db28: (2) No such file or directory 2020-10-05T11:56:15.163 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:56:15.159+0000 7f17b69860c0 0 WARNING: could not read zone params for zone id=bdf35e5b-c653-4ef8-994d-7961e459db28 name=test-zone2 2020-10-05T11:56:15.171 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:56:15.171 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "7a89cb1a-d0ea-4e52-a3d1-f1de1f9f3d6e", 2020-10-05T11:56:15.171 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zone3", 2020-10-05T11:56:15.171 INFO:teuthology.orchestra.run.smithi158.stdout: "domain_root": "test-zone3.rgw.meta:root", 2020-10-05T11:56:15.172 INFO:teuthology.orchestra.run.smithi158.stdout: "control_pool": "test-zone3.rgw.control", 2020-10-05T11:56:15.172 INFO:teuthology.orchestra.run.smithi158.stdout: "gc_pool": "test-zone3.rgw.log:gc", 2020-10-05T11:56:15.172 INFO:teuthology.orchestra.run.smithi158.stdout: "lc_pool": "test-zone3.rgw.log:lc", 2020-10-05T11:56:15.172 INFO:teuthology.orchestra.run.smithi158.stdout: "log_pool": "test-zone3.rgw.log", 2020-10-05T11:56:15.172 INFO:teuthology.orchestra.run.smithi158.stdout: "intent_log_pool": "test-zone3.rgw.log:intent", 2020-10-05T11:56:15.172 INFO:teuthology.orchestra.run.smithi158.stdout: "usage_log_pool": "test-zone3.rgw.log:usage", 2020-10-05T11:56:15.172 INFO:teuthology.orchestra.run.smithi158.stdout: "roles_pool": "test-zone3.rgw.meta:roles", 2020-10-05T11:56:15.173 INFO:teuthology.orchestra.run.smithi158.stdout: "reshard_pool": "test-zone3.rgw.log:reshard", 2020-10-05T11:56:15.173 INFO:teuthology.orchestra.run.smithi158.stdout: "user_keys_pool": "test-zone3.rgw.meta:users.keys", 2020-10-05T11:56:15.173 INFO:teuthology.orchestra.run.smithi158.stdout: "user_email_pool": "test-zone3.rgw.meta:users.email", 2020-10-05T11:56:15.173 INFO:teuthology.orchestra.run.smithi158.stdout: "user_swift_pool": "test-zone3.rgw.meta:users.swift", 2020-10-05T11:56:15.173 INFO:teuthology.orchestra.run.smithi158.stdout: "user_uid_pool": "test-zone3.rgw.meta:users.uid", 2020-10-05T11:56:15.173 INFO:teuthology.orchestra.run.smithi158.stdout: "otp_pool": "test-zone3.rgw.otp", 2020-10-05T11:56:15.173 INFO:teuthology.orchestra.run.smithi158.stdout: "system_key": { 2020-10-05T11:56:15.174 INFO:teuthology.orchestra.run.smithi158.stdout: "access_key": "VXETEEL80ZIAZNTY", 2020-10-05T11:56:15.174 INFO:teuthology.orchestra.run.smithi158.stdout: "secret_key": "VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv" 2020-10-05T11:56:15.174 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:15.174 INFO:teuthology.orchestra.run.smithi158.stdout: "placement_pools": [ 2020-10-05T11:56:15.174 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:15.174 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "default-placement", 2020-10-05T11:56:15.174 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:56:15.175 INFO:teuthology.orchestra.run.smithi158.stdout: "index_pool": "test-zone3.rgw.buckets.index", 2020-10-05T11:56:15.175 INFO:teuthology.orchestra.run.smithi158.stdout: "storage_classes": { 2020-10-05T11:56:15.175 INFO:teuthology.orchestra.run.smithi158.stdout: "STANDARD": { 2020-10-05T11:56:15.175 INFO:teuthology.orchestra.run.smithi158.stdout: "data_pool": "test-zone3.rgw.buckets.data" 2020-10-05T11:56:15.175 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:56:15.175 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:15.175 INFO:teuthology.orchestra.run.smithi158.stdout: "data_extra_pool": "test-zone3.rgw.buckets.non-ec", 2020-10-05T11:56:15.176 INFO:teuthology.orchestra.run.smithi158.stdout: "index_type": 0 2020-10-05T11:56:15.176 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:56:15.176 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:56:15.176 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:56:15.176 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:56:15.176 INFO:teuthology.orchestra.run.smithi158.stdout: "notif_pool": "test-zone3.rgw.log:notif" 2020-10-05T11:56:15.176 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:56:15.177 INFO:teuthology.orchestra.run.smithi158:> sudo ceph osd pool create test-zone3.rgw.buckets.data 64 64 --cluster c1 2020-10-05T11:56:16.252 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'test-zone3.rgw.buckets.data' created 2020-10-05T11:56:16.270 INFO:teuthology.orchestra.run.smithi158:> sudo ceph osd pool application enable test-zone3.rgw.buckets.data rgw --cluster c1 2020-10-05T11:56:16.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2020-10-05T11:56:17.258 INFO:teuthology.orchestra.run.smithi158.stderr:enabled application 'rgw' on pool 'test-zone3.rgw.buckets.data' 2020-10-05T11:56:17.284 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:17.284 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:17.284 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T11:56:17.335 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:56:17.335 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:56:17.359 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:56:17.360 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "7a89cb1a-d0ea-4e52-a3d1-f1de1f9f3d6e", 2020-10-05T11:56:17.360 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zone3", 2020-10-05T11:56:17.360 INFO:teuthology.orchestra.run.smithi158.stdout: "domain_root": "test-zone3.rgw.meta:root", 2020-10-05T11:56:17.361 INFO:teuthology.orchestra.run.smithi158.stdout: "control_pool": "test-zone3.rgw.control", 2020-10-05T11:56:17.361 INFO:teuthology.orchestra.run.smithi158.stdout: "gc_pool": "test-zone3.rgw.log:gc", 2020-10-05T11:56:17.361 INFO:teuthology.orchestra.run.smithi158.stdout: "lc_pool": "test-zone3.rgw.log:lc", 2020-10-05T11:56:17.362 INFO:teuthology.orchestra.run.smithi158.stdout: "log_pool": "test-zone3.rgw.log", 2020-10-05T11:56:17.362 INFO:teuthology.orchestra.run.smithi158.stdout: "intent_log_pool": "test-zone3.rgw.log:intent", 2020-10-05T11:56:17.362 INFO:teuthology.orchestra.run.smithi158.stdout: "usage_log_pool": "test-zone3.rgw.log:usage", 2020-10-05T11:56:17.362 INFO:teuthology.orchestra.run.smithi158.stdout: "roles_pool": "test-zone3.rgw.meta:roles", 2020-10-05T11:56:17.363 INFO:teuthology.orchestra.run.smithi158.stdout: "reshard_pool": "test-zone3.rgw.log:reshard", 2020-10-05T11:56:17.363 INFO:teuthology.orchestra.run.smithi158.stdout: "user_keys_pool": "test-zone3.rgw.meta:users.keys", 2020-10-05T11:56:17.363 INFO:teuthology.orchestra.run.smithi158.stdout: "user_email_pool": "test-zone3.rgw.meta:users.email", 2020-10-05T11:56:17.364 INFO:teuthology.orchestra.run.smithi158.stdout: "user_swift_pool": "test-zone3.rgw.meta:users.swift", 2020-10-05T11:56:17.364 INFO:teuthology.orchestra.run.smithi158.stdout: "user_uid_pool": "test-zone3.rgw.meta:users.uid", 2020-10-05T11:56:17.364 INFO:teuthology.orchestra.run.smithi158.stdout: "otp_pool": "test-zone3.rgw.otp", 2020-10-05T11:56:17.364 INFO:teuthology.orchestra.run.smithi158.stdout: "system_key": { 2020-10-05T11:56:17.365 INFO:teuthology.orchestra.run.smithi158.stdout: "access_key": "VXETEEL80ZIAZNTY", 2020-10-05T11:56:17.365 INFO:teuthology.orchestra.run.smithi158.stdout: "secret_key": "VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv" 2020-10-05T11:56:17.365 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:17.365 INFO:teuthology.orchestra.run.smithi158.stdout: "placement_pools": [ 2020-10-05T11:56:17.365 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:17.366 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "default-placement", 2020-10-05T11:56:17.366 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:56:17.366 INFO:teuthology.orchestra.run.smithi158.stdout: "index_pool": "test-zone3.rgw.buckets.index", 2020-10-05T11:56:17.366 INFO:teuthology.orchestra.run.smithi158.stdout: "storage_classes": { 2020-10-05T11:56:17.367 INFO:teuthology.orchestra.run.smithi158.stdout: "STANDARD": { 2020-10-05T11:56:17.367 INFO:teuthology.orchestra.run.smithi158.stdout: "data_pool": "test-zone3.rgw.buckets.data", 2020-10-05T11:56:17.367 INFO:teuthology.orchestra.run.smithi158.stdout: "compression_type": "random" 2020-10-05T11:56:17.367 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:56:17.367 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:17.367 INFO:teuthology.orchestra.run.smithi158.stdout: "data_extra_pool": "test-zone3.rgw.buckets.non-ec", 2020-10-05T11:56:17.368 INFO:teuthology.orchestra.run.smithi158.stdout: "index_type": 0 2020-10-05T11:56:17.368 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:56:17.368 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:56:17.368 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:56:17.368 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_id": "", 2020-10-05T11:56:17.368 INFO:teuthology.orchestra.run.smithi158.stdout: "notif_pool": "test-zone3.rgw.log:notif" 2020-10-05T11:56:17.368 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:56:17.369 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:17.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:17.370 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T11:56:17.407 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:56:17.407 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:56:25.481 INFO:teuthology.orchestra.run.smithi158.stderr:Sending period to new master zone 35a06950-5b24-42ca-86ff-3dc913eb1ccc 2020-10-05T11:56:25.546 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:56:25.547 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:56:25.547 INFO:teuthology.orchestra.run.smithi158.stdout: "epoch": 3, 2020-10-05T11:56:25.547 INFO:teuthology.orchestra.run.smithi158.stdout: "predecessor_uuid": "cf4e1d87-58bf-4037-99d7-c49aa5e5087e", 2020-10-05T11:56:25.547 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": [], 2020-10-05T11:56:25.548 INFO:teuthology.orchestra.run.smithi158.stdout: "period_map": { 2020-10-05T11:56:25.548 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:56:25.548 INFO:teuthology.orchestra.run.smithi158.stdout: "zonegroups": [ 2020-10-05T11:56:25.548 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:25.548 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "test-zonegroup", 2020-10-05T11:56:25.548 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zonegroup", 2020-10-05T11:56:25.549 INFO:teuthology.orchestra.run.smithi158.stdout: "api_name": "", 2020-10-05T11:56:25.549 INFO:teuthology.orchestra.run.smithi158.stdout: "is_master": "true", 2020-10-05T11:56:25.549 INFO:teuthology.orchestra.run.smithi158.stdout: "endpoints": [ 2020-10-05T11:56:25.549 INFO:teuthology.orchestra.run.smithi158.stdout: "http://smithi158.front.sepia.ceph.com:8000" 2020-10-05T11:56:25.549 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:56:25.549 INFO:teuthology.orchestra.run.smithi158.stdout: "hostnames": [], 2020-10-05T11:56:25.549 INFO:teuthology.orchestra.run.smithi158.stdout: "hostnames_s3website": [], 2020-10-05T11:56:25.550 INFO:teuthology.orchestra.run.smithi158.stdout: "master_zone": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:56:25.550 INFO:teuthology.orchestra.run.smithi158.stdout: "zones": [ 2020-10-05T11:56:25.550 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:25.550 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:56:25.550 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zone1", 2020-10-05T11:56:25.550 INFO:teuthology.orchestra.run.smithi158.stdout: "endpoints": [ 2020-10-05T11:56:25.551 INFO:teuthology.orchestra.run.smithi158.stdout: "http://smithi158.front.sepia.ceph.com:8000" 2020-10-05T11:56:25.551 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:56:25.551 INFO:teuthology.orchestra.run.smithi158.stdout: "log_meta": "false", 2020-10-05T11:56:25.551 INFO:teuthology.orchestra.run.smithi158.stdout: "log_data": "true", 2020-10-05T11:56:25.551 INFO:teuthology.orchestra.run.smithi158.stdout: "bucket_index_max_shards": 11, 2020-10-05T11:56:25.551 INFO:teuthology.orchestra.run.smithi158.stdout: "read_only": "false", 2020-10-05T11:56:25.551 INFO:teuthology.orchestra.run.smithi158.stdout: "tier_type": "", 2020-10-05T11:56:25.552 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from_all": "true", 2020-10-05T11:56:25.552 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from": [], 2020-10-05T11:56:25.552 INFO:teuthology.orchestra.run.smithi158.stdout: "redirect_zone": "" 2020-10-05T11:56:25.552 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:25.552 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:25.552 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "7a89cb1a-d0ea-4e52-a3d1-f1de1f9f3d6e", 2020-10-05T11:56:25.552 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zone3", 2020-10-05T11:56:25.553 INFO:teuthology.orchestra.run.smithi158.stdout: "endpoints": [ 2020-10-05T11:56:25.553 INFO:teuthology.orchestra.run.smithi158.stdout: "http://smithi158.front.sepia.ceph.com:8001" 2020-10-05T11:56:25.553 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:56:25.553 INFO:teuthology.orchestra.run.smithi158.stdout: "log_meta": "false", 2020-10-05T11:56:25.553 INFO:teuthology.orchestra.run.smithi158.stdout: "log_data": "true", 2020-10-05T11:56:25.553 INFO:teuthology.orchestra.run.smithi158.stdout: "bucket_index_max_shards": 11, 2020-10-05T11:56:25.554 INFO:teuthology.orchestra.run.smithi158.stdout: "read_only": "false", 2020-10-05T11:56:25.554 INFO:teuthology.orchestra.run.smithi158.stdout: "tier_type": "", 2020-10-05T11:56:25.554 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from_all": "true", 2020-10-05T11:56:25.554 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from": [], 2020-10-05T11:56:25.554 INFO:teuthology.orchestra.run.smithi158.stdout: "redirect_zone": "" 2020-10-05T11:56:25.554 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:25.554 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:25.555 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T11:56:25.555 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zone2", 2020-10-05T11:56:25.555 INFO:teuthology.orchestra.run.smithi158.stdout: "endpoints": [ 2020-10-05T11:56:25.555 INFO:teuthology.orchestra.run.smithi158.stdout: "http://smithi081.front.sepia.ceph.com:8000" 2020-10-05T11:56:25.555 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:56:25.555 INFO:teuthology.orchestra.run.smithi158.stdout: "log_meta": "false", 2020-10-05T11:56:25.556 INFO:teuthology.orchestra.run.smithi158.stdout: "log_data": "true", 2020-10-05T11:56:25.556 INFO:teuthology.orchestra.run.smithi158.stdout: "bucket_index_max_shards": 11, 2020-10-05T11:56:25.556 INFO:teuthology.orchestra.run.smithi158.stdout: "read_only": "false", 2020-10-05T11:56:25.556 INFO:teuthology.orchestra.run.smithi158.stdout: "tier_type": "", 2020-10-05T11:56:25.556 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from_all": "true", 2020-10-05T11:56:25.556 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from": [], 2020-10-05T11:56:25.556 INFO:teuthology.orchestra.run.smithi158.stdout: "redirect_zone": "" 2020-10-05T11:56:25.557 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:56:25.557 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:56:25.557 INFO:teuthology.orchestra.run.smithi158.stdout: "placement_targets": [ 2020-10-05T11:56:25.557 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:25.557 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "default-placement", 2020-10-05T11:56:25.557 INFO:teuthology.orchestra.run.smithi158.stdout: "tags": [], 2020-10-05T11:56:25.558 INFO:teuthology.orchestra.run.smithi158.stdout: "storage_classes": [ 2020-10-05T11:56:25.558 INFO:teuthology.orchestra.run.smithi158.stdout: "STANDARD" 2020-10-05T11:56:25.558 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T11:56:25.558 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:56:25.558 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:56:25.558 INFO:teuthology.orchestra.run.smithi158.stdout: "default_placement": "default-placement", 2020-10-05T11:56:25.558 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:56:25.559 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_policy": { 2020-10-05T11:56:25.559 INFO:teuthology.orchestra.run.smithi158.stdout: "groups": [] 2020-10-05T11:56:25.559 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:56:25.559 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:56:25.559 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:56:25.559 INFO:teuthology.orchestra.run.smithi158.stdout: "short_zone_ids": [ 2020-10-05T11:56:25.559 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:25.560 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:56:25.560 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 3324834999 2020-10-05T11:56:25.560 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:25.560 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:25.560 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "7a89cb1a-d0ea-4e52-a3d1-f1de1f9f3d6e", 2020-10-05T11:56:25.560 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 2396638170 2020-10-05T11:56:25.560 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:25.561 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:25.561 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T11:56:25.561 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 4213498805 2020-10-05T11:56:25.561 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:56:25.561 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T11:56:25.561 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:25.562 INFO:teuthology.orchestra.run.smithi158.stdout: "master_zonegroup": "test-zonegroup", 2020-10-05T11:56:25.562 INFO:teuthology.orchestra.run.smithi158.stdout: "master_zone": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:56:25.562 INFO:teuthology.orchestra.run.smithi158.stdout: "period_config": { 2020-10-05T11:56:25.562 INFO:teuthology.orchestra.run.smithi158.stdout: "bucket_quota": { 2020-10-05T11:56:25.562 INFO:teuthology.orchestra.run.smithi158.stdout: "enabled": false, 2020-10-05T11:56:25.562 INFO:teuthology.orchestra.run.smithi158.stdout: "check_on_raw": false, 2020-10-05T11:56:25.562 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size": -1, 2020-10-05T11:56:25.563 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size_kb": 0, 2020-10-05T11:56:25.563 INFO:teuthology.orchestra.run.smithi158.stdout: "max_objects": -1 2020-10-05T11:56:25.563 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:25.563 INFO:teuthology.orchestra.run.smithi158.stdout: "user_quota": { 2020-10-05T11:56:25.563 INFO:teuthology.orchestra.run.smithi158.stdout: "enabled": false, 2020-10-05T11:56:25.563 INFO:teuthology.orchestra.run.smithi158.stdout: "check_on_raw": false, 2020-10-05T11:56:25.574 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size": -1, 2020-10-05T11:56:25.575 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size_kb": 0, 2020-10-05T11:56:25.575 INFO:teuthology.orchestra.run.smithi158.stdout: "max_objects": -1 2020-10-05T11:56:25.575 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:56:25.575 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:25.575 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:56:25.575 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_name": "test-realm", 2020-10-05T11:56:25.576 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:56:25.576 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:56:25.577 DEBUG:tasks.rgw.c1.client.1:waiting for process to exit 2020-10-05T11:56:25.577 INFO:teuthology.orchestra.run:waiting for 300 2020-10-05T11:56:25.620 INFO:tasks.rgw.c1.client.1.smithi158.stdout:2020-10-05T11:56:25.619+0000 7f67ede25700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground (PID: 14124) UID: 0 2020-10-05T11:56:25.620 INFO:tasks.rgw.c1.client.1.smithi158.stdout:2020-10-05T11:56:25.619+0000 7f6804d88100 -1 shutting down 2020-10-05T11:56:27.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.1 is failed for ~0s 2020-10-05T11:56:31.679 INFO:tasks.rgw.c1.client.1:Stopped 2020-10-05T11:56:31.680 INFO:tasks.rgw.c1.client.1:Restarting daemon 2020-10-05T11:56:31.680 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.1.stdout 2>&1 2020-10-05T11:56:31.683 INFO:tasks.rgw.c1.client.1:Started 2020-10-05T11:56:31.683 INFO:teuthology.orchestra.run.smithi158:> curl http://smithi158.front.sepia.ceph.com:8001 2020-10-05T11:56:31.699 INFO:teuthology.orchestra.run.smithi158.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T11:56:31.699 INFO:teuthology.orchestra.run.smithi158.stderr: Dload Upload Total Spent Left Speed 2020-10-05T11:56:31.703 INFO:teuthology.orchestra.run.smithi158.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi158.front.sepia.ceph.com port 8001: Connection refused 2020-10-05T11:56:31.704 DEBUG:teuthology.orchestra.run:got remote process result: 7 2020-10-05T11:56:32.706 INFO:teuthology.orchestra.run.smithi158:> curl http://smithi158.front.sepia.ceph.com:8001 2020-10-05T11:56:32.725 INFO:teuthology.orchestra.run.smithi158.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T11:56:32.725 INFO:teuthology.orchestra.run.smithi158.stderr: Dload Upload Total Spent Left Speed 2020-10-05T11:56:32.730 INFO:teuthology.orchestra.run.smithi158.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2020-10-05T11:56:32.731 INFO:teuthology.orchestra.run.smithi158.stdout:anonymous 2020-10-05T11:56:32.732 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2020-10-05T11:56:32.732 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi158.front.sepia.ceph.com:8000', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--url', 'http://smithi158.front.sepia.ceph.com:8000', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:32.733 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi158.front.sepia.ceph.com:8000', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--url', 'http://smithi158.front.sepia.ceph.com:8000', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:32.733 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi158.front.sepia.ceph.com:8000 --access-key VXETEEL80ZIAZNTY --secret VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv --url http://smithi158.front.sepia.ceph.com:8000 --access-key VXETEEL80ZIAZNTY --secret VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv --cluster c2 --debug-rgw 0 --debug-ms 0 2020-10-05T11:56:32.794 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:56:32.794 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:56:32.842 INFO:tasks.rgw.c2.client.0.smithi081.stdout:2020-10-05T11:56:32.836+0000 7fe753646700 -1 rgw realm watcher: RGWRealmWatcher::handle_error oid=realms.5d355ff6-57c8-43c7-aa39-a3d6a281a382.control err=-107 2020-10-05T11:56:32.862 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:56:32.862 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:56:32.862 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-realm", 2020-10-05T11:56:32.862 INFO:teuthology.orchestra.run.smithi081.stdout: "current_period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:56:32.863 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 2 2020-10-05T11:56:32.863 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:56:32.864 INFO:tasks.rgw_multisite:creating zone.. 2020-10-05T11:56:32.864 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--endpoints', 'http://smithi081.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:32.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'VXETEEL80ZIAZNTY', '--secret', 'VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv', '--endpoints', 'http://smithi081.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:32.865 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key VXETEEL80ZIAZNTY --secret VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv --endpoints http://smithi081.front.sepia.ceph.com:8001 --tier-type pubsub --sync-from-all=0 --sync-from test-zone1 --tier-config start_with_full_sync=false,event_retention_days=7 --cluster c2 --debug-rgw 0 --debug-ms 0 2020-10-05T11:56:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:56:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:56:33.034 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:56:33.032+0000 7f3dea0d30c0 0 failed reading obj info from .rgw.root:zone_info.35a06950-5b24-42ca-86ff-3dc913eb1ccc: (2) No such file or directory 2020-10-05T11:56:33.035 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:56:33.032+0000 7f3dea0d30c0 0 WARNING: could not read zone params for zone id=35a06950-5b24-42ca-86ff-3dc913eb1ccc name=test-zone1 2020-10-05T11:56:33.035 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:56:33.032+0000 7f3dea0d30c0 0 failed reading obj info from .rgw.root:zone_info.7a89cb1a-d0ea-4e52-a3d1-f1de1f9f3d6e: (2) No such file or directory 2020-10-05T11:56:33.035 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:56:33.032+0000 7f3dea0d30c0 0 WARNING: could not read zone params for zone id=7a89cb1a-d0ea-4e52-a3d1-f1de1f9f3d6e name=test-zone3 2020-10-05T11:56:33.048 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:56:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "d4a952c4-a878-4b40-9af3-dc61e86204eb", 2020-10-05T11:56:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone4", 2020-10-05T11:56:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: "domain_root": "test-zone4.rgw.meta:root", 2020-10-05T11:56:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: "control_pool": "test-zone4.rgw.control", 2020-10-05T11:56:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: "gc_pool": "test-zone4.rgw.log:gc", 2020-10-05T11:56:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: "lc_pool": "test-zone4.rgw.log:lc", 2020-10-05T11:56:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: "log_pool": "test-zone4.rgw.log", 2020-10-05T11:56:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: "intent_log_pool": "test-zone4.rgw.log:intent", 2020-10-05T11:56:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: "usage_log_pool": "test-zone4.rgw.log:usage", 2020-10-05T11:56:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: "roles_pool": "test-zone4.rgw.meta:roles", 2020-10-05T11:56:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: "reshard_pool": "test-zone4.rgw.log:reshard", 2020-10-05T11:56:33.050 INFO:teuthology.orchestra.run.smithi081.stdout: "user_keys_pool": "test-zone4.rgw.meta:users.keys", 2020-10-05T11:56:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "user_email_pool": "test-zone4.rgw.meta:users.email", 2020-10-05T11:56:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "user_swift_pool": "test-zone4.rgw.meta:users.swift", 2020-10-05T11:56:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "user_uid_pool": "test-zone4.rgw.meta:users.uid", 2020-10-05T11:56:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "otp_pool": "test-zone4.rgw.otp", 2020-10-05T11:56:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "system_key": { 2020-10-05T11:56:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "access_key": "VXETEEL80ZIAZNTY", 2020-10-05T11:56:33.051 INFO:teuthology.orchestra.run.smithi081.stdout: "secret_key": "VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv" 2020-10-05T11:56:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "placement_pools": [ 2020-10-05T11:56:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "default-placement", 2020-10-05T11:56:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:56:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "index_pool": "test-zone4.rgw.buckets.index", 2020-10-05T11:56:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_classes": { 2020-10-05T11:56:33.052 INFO:teuthology.orchestra.run.smithi081.stdout: "STANDARD": { 2020-10-05T11:56:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: "data_pool": "test-zone4.rgw.buckets.data" 2020-10-05T11:56:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: "data_extra_pool": "test-zone4.rgw.buckets.non-ec", 2020-10-05T11:56:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: "index_type": 0 2020-10-05T11:56:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:33.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_config": { 2020-10-05T11:56:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event_retention_days": 7, 2020-10-05T11:56:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: "start_with_full_sync": false 2020-10-05T11:56:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:56:33.054 INFO:teuthology.orchestra.run.smithi081.stdout: "notif_pool": "test-zone4.rgw.log:notif" 2020-10-05T11:56:33.055 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:56:33.056 INFO:teuthology.orchestra.run.smithi081:> sudo ceph osd pool create test-zone4.rgw.buckets.data 64 64 --cluster c2 2020-10-05T11:56:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'test-zone4.rgw.buckets.data' created 2020-10-05T11:56:33.581 INFO:teuthology.orchestra.run.smithi081:> sudo ceph osd pool application enable test-zone4.rgw.buckets.data rgw --cluster c2 2020-10-05T11:56:33.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.1 has been restored 2020-10-05T11:56:34.571 INFO:teuthology.orchestra.run.smithi081.stderr:enabled application 'rgw' on pool 'test-zone4.rgw.buckets.data' 2020-10-05T11:56:34.608 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:34.609 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:34.609 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2020-10-05T11:56:34.655 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:56:34.655 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:56:34.674 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:56:34.675 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "d4a952c4-a878-4b40-9af3-dc61e86204eb", 2020-10-05T11:56:34.675 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone4", 2020-10-05T11:56:34.675 INFO:teuthology.orchestra.run.smithi081.stdout: "domain_root": "test-zone4.rgw.meta:root", 2020-10-05T11:56:34.675 INFO:teuthology.orchestra.run.smithi081.stdout: "control_pool": "test-zone4.rgw.control", 2020-10-05T11:56:34.676 INFO:teuthology.orchestra.run.smithi081.stdout: "gc_pool": "test-zone4.rgw.log:gc", 2020-10-05T11:56:34.676 INFO:teuthology.orchestra.run.smithi081.stdout: "lc_pool": "test-zone4.rgw.log:lc", 2020-10-05T11:56:34.676 INFO:teuthology.orchestra.run.smithi081.stdout: "log_pool": "test-zone4.rgw.log", 2020-10-05T11:56:34.677 INFO:teuthology.orchestra.run.smithi081.stdout: "intent_log_pool": "test-zone4.rgw.log:intent", 2020-10-05T11:56:34.677 INFO:teuthology.orchestra.run.smithi081.stdout: "usage_log_pool": "test-zone4.rgw.log:usage", 2020-10-05T11:56:34.677 INFO:teuthology.orchestra.run.smithi081.stdout: "roles_pool": "test-zone4.rgw.meta:roles", 2020-10-05T11:56:34.677 INFO:teuthology.orchestra.run.smithi081.stdout: "reshard_pool": "test-zone4.rgw.log:reshard", 2020-10-05T11:56:34.677 INFO:teuthology.orchestra.run.smithi081.stdout: "user_keys_pool": "test-zone4.rgw.meta:users.keys", 2020-10-05T11:56:34.678 INFO:teuthology.orchestra.run.smithi081.stdout: "user_email_pool": "test-zone4.rgw.meta:users.email", 2020-10-05T11:56:34.678 INFO:teuthology.orchestra.run.smithi081.stdout: "user_swift_pool": "test-zone4.rgw.meta:users.swift", 2020-10-05T11:56:34.678 INFO:teuthology.orchestra.run.smithi081.stdout: "user_uid_pool": "test-zone4.rgw.meta:users.uid", 2020-10-05T11:56:34.678 INFO:teuthology.orchestra.run.smithi081.stdout: "otp_pool": "test-zone4.rgw.otp", 2020-10-05T11:56:34.678 INFO:teuthology.orchestra.run.smithi081.stdout: "system_key": { 2020-10-05T11:56:34.678 INFO:teuthology.orchestra.run.smithi081.stdout: "access_key": "VXETEEL80ZIAZNTY", 2020-10-05T11:56:34.678 INFO:teuthology.orchestra.run.smithi081.stdout: "secret_key": "VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv" 2020-10-05T11:56:34.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:34.679 INFO:teuthology.orchestra.run.smithi081.stdout: "placement_pools": [ 2020-10-05T11:56:34.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:34.679 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "default-placement", 2020-10-05T11:56:34.679 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:56:34.679 INFO:teuthology.orchestra.run.smithi081.stdout: "index_pool": "test-zone4.rgw.buckets.index", 2020-10-05T11:56:34.679 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_classes": { 2020-10-05T11:56:34.680 INFO:teuthology.orchestra.run.smithi081.stdout: "STANDARD": { 2020-10-05T11:56:34.680 INFO:teuthology.orchestra.run.smithi081.stdout: "data_pool": "test-zone4.rgw.buckets.data", 2020-10-05T11:56:34.680 INFO:teuthology.orchestra.run.smithi081.stdout: "compression_type": "random" 2020-10-05T11:56:34.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:34.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:34.680 INFO:teuthology.orchestra.run.smithi081.stdout: "data_extra_pool": "test-zone4.rgw.buckets.non-ec", 2020-10-05T11:56:34.681 INFO:teuthology.orchestra.run.smithi081.stdout: "index_type": 0 2020-10-05T11:56:34.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:34.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:34.681 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:34.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_config": { 2020-10-05T11:56:34.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event_retention_days": 7, 2020-10-05T11:56:34.681 INFO:teuthology.orchestra.run.smithi081.stdout: "start_with_full_sync": false 2020-10-05T11:56:34.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:34.682 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_id": "", 2020-10-05T11:56:34.682 INFO:teuthology.orchestra.run.smithi081.stdout: "notif_pool": "test-zone4.rgw.log:notif" 2020-10-05T11:56:34.682 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:56:34.683 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:34.684 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:34.684 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2020-10-05T11:56:34.764 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:56:34.765 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:56:42.778 INFO:teuthology.orchestra.run.smithi081.stderr:Sending period to new master zone 35a06950-5b24-42ca-86ff-3dc913eb1ccc 2020-10-05T11:56:42.843 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:56:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:56:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 4, 2020-10-05T11:56:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "predecessor_uuid": "cf4e1d87-58bf-4037-99d7-c49aa5e5087e", 2020-10-05T11:56:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": [], 2020-10-05T11:56:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "period_map": { 2020-10-05T11:56:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:56:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "zonegroups": [ 2020-10-05T11:56:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "test-zonegroup", 2020-10-05T11:56:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zonegroup", 2020-10-05T11:56:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "api_name": "", 2020-10-05T11:56:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "is_master": "true", 2020-10-05T11:56:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "endpoints": [ 2020-10-05T11:56:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "http://smithi158.front.sepia.ceph.com:8000" 2020-10-05T11:56:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "hostnames": [], 2020-10-05T11:56:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "hostnames_s3website": [], 2020-10-05T11:56:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "master_zone": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:56:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "zones": [ 2020-10-05T11:56:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:56:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone1", 2020-10-05T11:56:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "endpoints": [ 2020-10-05T11:56:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "http://smithi158.front.sepia.ceph.com:8000" 2020-10-05T11:56:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: "log_meta": "false", 2020-10-05T11:56:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: "log_data": "true", 2020-10-05T11:56:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: "bucket_index_max_shards": 11, 2020-10-05T11:56:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: "read_only": "false", 2020-10-05T11:56:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_type": "", 2020-10-05T11:56:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from_all": "true", 2020-10-05T11:56:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from": [], 2020-10-05T11:56:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_zone": "" 2020-10-05T11:56:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "7a89cb1a-d0ea-4e52-a3d1-f1de1f9f3d6e", 2020-10-05T11:56:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone3", 2020-10-05T11:56:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "endpoints": [ 2020-10-05T11:56:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "http://smithi158.front.sepia.ceph.com:8001" 2020-10-05T11:56:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "log_meta": "false", 2020-10-05T11:56:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "log_data": "true", 2020-10-05T11:56:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "bucket_index_max_shards": 11, 2020-10-05T11:56:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "read_only": "false", 2020-10-05T11:56:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_type": "", 2020-10-05T11:56:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from_all": "true", 2020-10-05T11:56:42.851 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from": [], 2020-10-05T11:56:42.851 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_zone": "" 2020-10-05T11:56:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T11:56:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone2", 2020-10-05T11:56:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: "endpoints": [ 2020-10-05T11:56:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: "http://smithi081.front.sepia.ceph.com:8000" 2020-10-05T11:56:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "log_meta": "false", 2020-10-05T11:56:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "log_data": "true", 2020-10-05T11:56:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "bucket_index_max_shards": 11, 2020-10-05T11:56:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "read_only": "false", 2020-10-05T11:56:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_type": "", 2020-10-05T11:56:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from_all": "true", 2020-10-05T11:56:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from": [], 2020-10-05T11:56:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_zone": "" 2020-10-05T11:56:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "d4a952c4-a878-4b40-9af3-dc61e86204eb", 2020-10-05T11:56:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone4", 2020-10-05T11:56:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "endpoints": [ 2020-10-05T11:56:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "http://smithi081.front.sepia.ceph.com:8001" 2020-10-05T11:56:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "log_meta": "false", 2020-10-05T11:56:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "log_data": "true", 2020-10-05T11:56:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "bucket_index_max_shards": 11, 2020-10-05T11:56:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "read_only": "false", 2020-10-05T11:56:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_type": "pubsub", 2020-10-05T11:56:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from_all": "false", 2020-10-05T11:56:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from": [ 2020-10-05T11:56:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: "test-zone1" 2020-10-05T11:56:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_zone": "" 2020-10-05T11:56:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "placement_targets": [ 2020-10-05T11:56:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default-placement", 2020-10-05T11:56:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2020-10-05T11:56:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_classes": [ 2020-10-05T11:56:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "STANDARD" 2020-10-05T11:56:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:56:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: "default_placement": "default-placement", 2020-10-05T11:56:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:56:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_policy": { 2020-10-05T11:56:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: "groups": [] 2020-10-05T11:56:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T11:56:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: "short_zone_ids": [ 2020-10-05T11:56:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:56:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 3324834999 2020-10-05T11:56:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "7a89cb1a-d0ea-4e52-a3d1-f1de1f9f3d6e", 2020-10-05T11:56:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 2396638170 2020-10-05T11:56:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T11:56:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 4213498805 2020-10-05T11:56:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "d4a952c4-a878-4b40-9af3-dc61e86204eb", 2020-10-05T11:56:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 3646836627 2020-10-05T11:56:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:56:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: "master_zonegroup": "test-zonegroup", 2020-10-05T11:56:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "master_zone": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T11:56:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "period_config": { 2020-10-05T11:56:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "bucket_quota": { 2020-10-05T11:56:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": false, 2020-10-05T11:56:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "check_on_raw": false, 2020-10-05T11:56:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "max_size": -1, 2020-10-05T11:56:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "max_size_kb": 0, 2020-10-05T11:56:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: "max_objects": -1 2020-10-05T11:56:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: "user_quota": { 2020-10-05T11:56:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": false, 2020-10-05T11:56:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: "check_on_raw": false, 2020-10-05T11:56:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: "max_size": -1, 2020-10-05T11:56:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: "max_size_kb": 0, 2020-10-05T11:56:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "max_objects": -1 2020-10-05T11:56:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T11:56:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_name": "test-realm", 2020-10-05T11:56:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:56:43.032 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:56:43.034 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2020-10-05T11:56:43.034 INFO:teuthology.orchestra.run:waiting for 300 2020-10-05T11:56:43.080 INFO:tasks.rgw.c2.client.1.smithi081.stdout:2020-10-05T11:56:43.080+0000 7f9c95505700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground (PID: 14328) UID: 0 2020-10-05T11:56:43.081 INFO:tasks.rgw.c2.client.1.smithi081.stdout:2020-10-05T11:56:43.080+0000 7f9cac468100 -1 shutting down 2020-10-05T11:56:44.899 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 is failed for ~0s 2020-10-05T11:56:49.136 INFO:tasks.rgw.c2.client.1:Stopped 2020-10-05T11:56:49.137 INFO:tasks.rgw.c2.client.1:Restarting daemon 2020-10-05T11:56:49.138 INFO:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2020-10-05T11:56:49.141 INFO:tasks.rgw.c2.client.1:Started 2020-10-05T11:56:49.142 INFO:teuthology.orchestra.run.smithi081:> curl http://smithi081.front.sepia.ceph.com:8001 2020-10-05T11:56:49.158 INFO:teuthology.orchestra.run.smithi081.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T11:56:49.159 INFO:teuthology.orchestra.run.smithi081.stderr: Dload Upload Total Spent Left Speed 2020-10-05T11:56:49.162 INFO:teuthology.orchestra.run.smithi081.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi081.front.sepia.ceph.com port 8001: Connection refused 2020-10-05T11:56:49.163 DEBUG:teuthology.orchestra.run:got remote process result: 7 2020-10-05T11:56:50.164 INFO:teuthology.orchestra.run.smithi081:> curl http://smithi081.front.sepia.ceph.com:8001 2020-10-05T11:56:50.180 INFO:teuthology.orchestra.run.smithi081.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T11:56:50.180 INFO:teuthology.orchestra.run.smithi081.stderr: Dload Upload Total Spent Left Speed 2020-10-05T11:56:50.184 INFO:teuthology.orchestra.run.smithi081.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 134 100 134 0 0 26800 0 --:--:-- --:--:-- --:--:-- 26800 2020-10-05T11:56:50.185 INFO:teuthology.orchestra.run.smithi081.stdout:{"Code":"MethodNotAllowed","RequestId":"tx000000000000000000001-005f7b0a02-10ea-test-zone4","HostId":"10ea-test-zone4-test-zonegroup"} 2020-10-05T11:56:50.186 INFO:tasks.rgw_multisite:rgw multisite configuration completed 2020-10-05T11:56:50.186 INFO:teuthology.run_tasks:Running task rgw-multisite-tests... 2020-10-05T11:56:50.264 INFO:tasks.rgw_multisite_tests:creating test user.. 2020-10-05T11:56:50.264 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:50.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T11:56:50.265 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid rgw-multisite-test-user --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Multisite Test User' --gen-access-key --gen-secret --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T11:56:50.310 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:56:50.310 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:56:50.538 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:56:50.538 INFO:teuthology.orchestra.run.smithi158.stdout: "user_id": "rgw-multisite-test-user", 2020-10-05T11:56:50.539 INFO:teuthology.orchestra.run.smithi158.stdout: "display_name": "Multisite Test User", 2020-10-05T11:56:50.539 INFO:teuthology.orchestra.run.smithi158.stdout: "email": "", 2020-10-05T11:56:50.539 INFO:teuthology.orchestra.run.smithi158.stdout: "suspended": 0, 2020-10-05T11:56:50.539 INFO:teuthology.orchestra.run.smithi158.stdout: "max_buckets": 1000, 2020-10-05T11:56:50.540 INFO:teuthology.orchestra.run.smithi158.stdout: "subusers": [], 2020-10-05T11:56:50.540 INFO:teuthology.orchestra.run.smithi158.stdout: "keys": [ 2020-10-05T11:56:50.540 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:50.540 INFO:teuthology.orchestra.run.smithi158.stdout: "user": "rgw-multisite-test-user", 2020-10-05T11:56:50.540 INFO:teuthology.orchestra.run.smithi158.stdout: "access_key": "2PF1EQPIHYFKA4YUOMER", 2020-10-05T11:56:50.540 INFO:teuthology.orchestra.run.smithi158.stdout: "secret_key": "B6HXcOU3cgVC9lNnpQ8oNoCLMBMffYuj6jEwTiBp" 2020-10-05T11:56:50.541 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:56:50.541 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T11:56:50.541 INFO:teuthology.orchestra.run.smithi158.stdout: "swift_keys": [], 2020-10-05T11:56:50.541 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": [], 2020-10-05T11:56:50.542 INFO:teuthology.orchestra.run.smithi158.stdout: "op_mask": "read, write, delete", 2020-10-05T11:56:50.542 INFO:teuthology.orchestra.run.smithi158.stdout: "default_placement": "", 2020-10-05T11:56:50.542 INFO:teuthology.orchestra.run.smithi158.stdout: "default_storage_class": "", 2020-10-05T11:56:50.543 INFO:teuthology.orchestra.run.smithi158.stdout: "placement_tags": [], 2020-10-05T11:56:50.543 INFO:teuthology.orchestra.run.smithi158.stdout: "bucket_quota": { 2020-10-05T11:56:50.543 INFO:teuthology.orchestra.run.smithi158.stdout: "enabled": false, 2020-10-05T11:56:50.544 INFO:teuthology.orchestra.run.smithi158.stdout: "check_on_raw": false, 2020-10-05T11:56:50.544 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size": -1, 2020-10-05T11:56:50.544 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size_kb": 0, 2020-10-05T11:56:50.545 INFO:teuthology.orchestra.run.smithi158.stdout: "max_objects": -1 2020-10-05T11:56:50.545 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:50.545 INFO:teuthology.orchestra.run.smithi158.stdout: "user_quota": { 2020-10-05T11:56:50.545 INFO:teuthology.orchestra.run.smithi158.stdout: "enabled": false, 2020-10-05T11:56:50.545 INFO:teuthology.orchestra.run.smithi158.stdout: "check_on_raw": false, 2020-10-05T11:56:50.545 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size": -1, 2020-10-05T11:56:50.546 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size_kb": 0, 2020-10-05T11:56:50.546 INFO:teuthology.orchestra.run.smithi158.stdout: "max_objects": -1 2020-10-05T11:56:50.546 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:50.546 INFO:teuthology.orchestra.run.smithi158.stdout: "temp_url_keys": [], 2020-10-05T11:56:50.546 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "rgw", 2020-10-05T11:56:50.546 INFO:teuthology.orchestra.run.smithi158.stdout: "mfa_ids": [] 2020-10-05T11:56:50.547 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:56:50.547 INFO:teuthology.orchestra.run.smithi158.stdout: 2020-10-05T11:56:50.567 INFO:rgw_multi.tests:meta checkpoint 2020-10-05T11:56:50.568 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:56:50.568 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:56:50.569 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:56:50.656 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:56:50.657 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:56:50.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 has been restored 2020-10-05T11:56:50.866 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T11:56:50.900 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T11:56:50.900 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:50.900 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:56:50.901 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:56:50.531704Z" 2020-10-05T11:56:50.901 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:50.901 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:50.901 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:56:50.901 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:56:50.901 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:50.902 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:50.902 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:56:50.902 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:56:50.902 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:56:50.902 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:56:50.902 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:56:50.902 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:56:50.903 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:56:50.903 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T11:56:50.904 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T11:56:50.904 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:56:50.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:56:50.905 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:56:50.944 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:56:50.944 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:56:51.182 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:56:51.183 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:56:51.183 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:56:51.184 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:56:51.184 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:56:51.184 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:56:51.184 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:56:51.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:51.185 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:56:51.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:51.185 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:56:51.185 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:56:51.186 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:56:51.186 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:56:51.186 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:56:51.187 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:56:51.187 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:56:51.187 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:56:51.187 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:56:51.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:51.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:51.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:51.188 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:56:51.188 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:56:51.189 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:56:51.189 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:56:51.189 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:56:51.189 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:56:51.190 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:56:51.190 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:56:51.190 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:56:51.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:51.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:51.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:51.191 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:56:51.191 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:56:51.192 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:56:51.192 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:56:51.192 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:56:51.192 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:56:51.193 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:56:51.193 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:56:51.193 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:56:51.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:51.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:51.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:51.194 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:56:51.194 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:56:51.194 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:56:51.194 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:56:51.194 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:56:51.195 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:56:51.195 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:56:51.195 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:56:51.195 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:56:51.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:51.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:51.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:56:51.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:51.196 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:56:51.196 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:56:51.196 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:56:51.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:51.196 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:56:51.197 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:56:56.199 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:56:56.199 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:56:56.200 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:56:56.240 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:56:56.241 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:56:56.498 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:56:56.499 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:56:56.499 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:56:56.499 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:56:56.499 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:56:56.499 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:56:56.500 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:56:56.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:56.500 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:56:56.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:56.500 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:56:56.500 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:56:56.500 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:56:56.501 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:56:56.501 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:56:56.501 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:56:56.501 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:56:56.501 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:56:56.501 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:56:56.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:56.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:56.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:56.502 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:56:56.502 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:56:56.502 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:56:56.502 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:56:56.502 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:56:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:56:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:56:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:56:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:56:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:56:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:56:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:56:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:56:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:56:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:56:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:56:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:56:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:56:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:56:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:56:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:56:56.506 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:56:56.506 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:56:56.506 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:56:56.506 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:56:56.506 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:56:56.506 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:56:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:56:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:56:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:56:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:56:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:56:56.508 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:56:56.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:56:56.508 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:56:56.509 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:57:01.510 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:01.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:01.511 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:57:01.550 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:57:01.550 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:57:01.809 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:57:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:57:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:57:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:57:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:57:01.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:57:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:57:01.811 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:57:01.812 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:57:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:01.814 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:01.815 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:57:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:01.816 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:01.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:57:01.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:57:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:57:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:57:01.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:01.819 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:57:01.820 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:57:06.822 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:06.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:06.823 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:57:06.863 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:57:06.864 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:57:07.105 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:57:07.106 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:57:07.106 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:57:07.106 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:57:07.106 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:57:07.107 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:57:07.107 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:07.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:07.107 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:57:07.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:07.107 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:57:07.108 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:07.108 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:07.108 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:07.108 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:07.108 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:57:07.108 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:07.108 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:07.109 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:07.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:07.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:07.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:07.109 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:57:07.109 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:07.109 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:07.110 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:07.110 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:07.110 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:07.110 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:07.110 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:07.110 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:07.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:07.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:07.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:07.111 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:57:07.111 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:07.112 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:07.112 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:07.112 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:07.112 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:07.112 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:07.112 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:07.112 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:07.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:07.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:07.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:07.113 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:57:07.113 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:07.113 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:07.113 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:07.114 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:07.114 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:07.114 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:07.114 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:07.114 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:07.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:07.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:07.115 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:57:07.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:07.115 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:57:07.115 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:57:07.115 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:57:07.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:07.115 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:57:07.116 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:57:12.118 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:12.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:12.119 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:57:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:57:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:57:12.396 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:57:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:57:12.396 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:57:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:57:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:57:12.397 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:57:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:12.398 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:57:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:57:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:12.399 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:57:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:12.400 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:57:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:12.401 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:12.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:57:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:12.403 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:57:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:57:12.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:57:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:57:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:57:12.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:12.407 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:57:12.408 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:57:17.410 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:17.410 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:17.411 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:57:17.449 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:57:17.450 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:57:17.693 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:57:17.693 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:57:17.694 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:57:17.694 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:57:17.694 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:57:17.694 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:57:17.694 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:17.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:17.694 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:57:17.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:17.695 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:57:17.695 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:17.695 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:17.695 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:17.695 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:17.695 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:57:17.696 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:17.696 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:17.696 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:17.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:17.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:17.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:17.696 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:57:17.697 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:17.697 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:17.697 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:17.697 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:17.697 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:17.697 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:17.697 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:17.698 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:17.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:17.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:17.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:17.698 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:57:17.698 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:17.698 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:17.699 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:17.699 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:17.699 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:17.699 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:17.699 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:17.699 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:17.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:17.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:17.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:17.700 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:57:17.700 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:17.700 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:17.700 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:17.700 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:17.700 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:17.701 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:17.701 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:17.701 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:17.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:17.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:17.701 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:57:17.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:17.702 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:57:17.702 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:57:17.702 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:57:17.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:17.702 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:57:17.703 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:57:22.704 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:22.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:22.705 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:57:22.746 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:57:22.747 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:57:22.996 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:57:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:57:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:57:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:57:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:57:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:57:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:57:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:57:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:22.999 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:22.999 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:22.999 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:57:22.999 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:22.999 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:22.999 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:22.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:23.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:23.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:23.000 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:57:23.000 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:23.000 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:23.000 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:23.000 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:23.001 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:23.001 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:23.001 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:23.001 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:23.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:23.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:23.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:23.002 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:57:23.002 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:23.002 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:23.002 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:23.002 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:23.002 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:23.002 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:23.003 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:23.003 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:23.003 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:23.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:23.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:23.003 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:57:23.003 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:23.003 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:23.004 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:23.004 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:23.004 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:23.004 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:23.004 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:23.004 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:23.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:23.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:23.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:57:23.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:23.005 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:57:23.005 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:57:23.005 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:57:23.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:23.006 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:57:23.007 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:57:28.007 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:28.008 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:28.009 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:57:28.048 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:57:28.048 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:57:28.298 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:57:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:57:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:57:28.299 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:57:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:57:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:57:28.300 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:57:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:57:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:28.301 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:57:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:28.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:57:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:28.303 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:57:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:28.306 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:28.307 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:28.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:57:28.309 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:28.310 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:28.311 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:57:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:28.312 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:57:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:57:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:57:28.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:28.313 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:57:28.315 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:57:33.315 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:33.316 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:33.317 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:57:33.356 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:57:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:57:33.597 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:57:33.597 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:57:33.598 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:57:33.598 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:57:33.598 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:57:33.599 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:57:33.599 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:33.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:33.600 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:57:33.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:33.600 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:57:33.600 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:33.601 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:33.601 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:33.601 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:33.601 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:57:33.601 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:33.601 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:33.601 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:33.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:33.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:33.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:33.602 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:57:33.602 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:33.602 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:33.603 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:33.603 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:33.603 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:33.603 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:33.603 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:33.603 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:33.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:33.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:33.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:33.604 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:57:33.604 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:33.604 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:33.604 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:33.604 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:33.604 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:33.605 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:33.605 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:33.605 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:33.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:33.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:33.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:33.605 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:57:33.606 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:33.606 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:33.606 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:33.606 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:33.606 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:33.606 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:33.606 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:33.607 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:33.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:33.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:33.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:57:33.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:33.607 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:57:33.607 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:57:33.608 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:57:33.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:33.608 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:57:33.609 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:57:38.610 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:38.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:38.611 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:57:38.646 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:57:38.646 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:57:38.901 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:57:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:57:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:57:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:57:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:57:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:57:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:57:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:57:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:57:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:57:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:57:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:57:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:57:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:57:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:57:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:57:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:38.910 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:57:38.911 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:57:43.913 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:43.914 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:43.914 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:57:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:57:43.955 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:57:44.205 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:57:44.206 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:57:44.206 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:57:44.206 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:57:44.206 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:57:44.207 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:57:44.207 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:44.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:44.207 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:57:44.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:44.207 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:57:44.208 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:44.208 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:44.208 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:44.208 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:44.208 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:57:44.208 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:44.208 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:44.209 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:44.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:44.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:44.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:44.209 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:57:44.209 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:44.210 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:44.210 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:44.210 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:44.210 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:44.210 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:44.210 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:44.210 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:44.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:44.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:44.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:44.211 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:57:44.211 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:44.211 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:44.212 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:44.212 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:44.212 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:44.212 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:44.213 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:44.213 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:44.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:44.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:44.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:44.214 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:57:44.214 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:44.214 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:44.214 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:44.214 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:44.214 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:44.214 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:44.215 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:44.215 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:44.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:44.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:44.215 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:57:44.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:44.216 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:57:44.216 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:57:44.216 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:57:44.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:44.216 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:57:44.218 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:57:49.219 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:49.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:49.220 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:57:49.260 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:57:49.260 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:57:49.492 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:57:49.492 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:57:49.493 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:57:49.493 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:57:49.493 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:57:49.493 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:57:49.493 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:49.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:49.494 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:57:49.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:49.494 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:57:49.494 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:49.494 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:49.494 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:49.494 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:49.495 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:57:49.495 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:49.495 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:49.495 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:49.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:49.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:49.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:57:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:57:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:57:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:57:49.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:49.501 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:57:49.501 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:57:49.501 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:57:49.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:49.501 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:57:49.502 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:57:54.503 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:54.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:54.504 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:57:54.545 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:57:54.545 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:57:54.789 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:57:54.789 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:57:54.789 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:57:54.789 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:57:54.790 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:57:54.790 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:57:54.790 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:54.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:54.790 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:57:54.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:54.791 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:57:54.791 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:54.791 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:54.791 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:54.791 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:54.792 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:57:54.792 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:54.792 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:54.792 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:54.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:54.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:54.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:54.793 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:57:54.793 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:54.793 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:54.793 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:54.793 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:54.793 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:54.793 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:54.794 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:54.794 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:54.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:54.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:54.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:54.794 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:57:54.795 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:54.795 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:54.795 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:54.795 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:54.795 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:54.795 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:54.795 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:54.795 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:54.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:54.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:54.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:57:54.796 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:57:54.796 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:57:54.796 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:57:54.796 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:57:54.797 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:57:54.797 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:57:54.797 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:57:54.797 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:57:54.797 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:57:54.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:54.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:54.798 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:57:54.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:57:54.798 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:57:54.798 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:57:54.798 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:57:54.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:57:54.798 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:57:54.799 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:57:59.801 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:59.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:57:59.802 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:57:59.844 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:57:59.844 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:00.079 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:00.079 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:00.080 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:00.081 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:00.082 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:00.083 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:00.084 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:00.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:00.086 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:00.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:00.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:00.088 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:00.089 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:58:05.091 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:05.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:05.092 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:05.132 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:05.380 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:05.389 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:05.390 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:58:10.392 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:10.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:10.393 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:10.652 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:10.652 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:10.652 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:10.653 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:10.653 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:10.653 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:10.653 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:10.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:10.653 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:10.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:10.654 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:10.654 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:10.654 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:10.654 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:10.654 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:10.655 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:10.655 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:10.655 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:10.655 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:10.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:10.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:10.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:10.656 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:10.656 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:10.656 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:10.656 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:10.656 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:10.656 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:10.657 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:10.657 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:10.657 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:10.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:10.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:10.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:10.657 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:10.658 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:10.658 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:10.658 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:10.658 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:10.658 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:10.658 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:10.659 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:10.659 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:10.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:10.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:10.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:10.659 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:10.659 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:10.660 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:10.660 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:10.660 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:10.660 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:10.660 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:10.660 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:10.661 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:10.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:10.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:10.661 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:10.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:10.661 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:10.662 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:10.662 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:10.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:10.662 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:10.663 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:58:15.663 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:15.664 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:15.665 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:15.952 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:15.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:15.954 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:15.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:15.956 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:15.957 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:15.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:15.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:15.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:15.959 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:15.959 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:15.959 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:15.959 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:15.959 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:15.960 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:15.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:15.961 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:15.962 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:58:20.964 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:20.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:20.965 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:21.003 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:21.265 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:21.265 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:21.265 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:21.266 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:21.266 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:21.266 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:21.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:21.266 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:21.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:21.266 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:21.267 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:21.267 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:21.267 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:21.267 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:21.267 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:21.267 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:21.267 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:21.268 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:21.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:21.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:21.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:21.268 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:21.268 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:21.268 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:21.269 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:21.269 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:21.269 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:21.269 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:21.269 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:21.269 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:21.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:21.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:21.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:21.270 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:21.270 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:21.270 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:21.270 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:21.270 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:21.271 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:21.271 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:21.271 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:21.271 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:21.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:21.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:21.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:21.272 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:21.272 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:21.272 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:21.272 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:21.272 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:21.272 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:21.272 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:21.272 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:21.273 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:21.273 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:21.273 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:21.273 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:21.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:21.273 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:21.274 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:21.274 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:21.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:21.275 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:58:26.276 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:26.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:26.278 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:26.318 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:26.318 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:26.553 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:26.566 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:26.566 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:58:31.568 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:31.568 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:31.569 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:31.608 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:31.875 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:31.875 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:31.875 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:31.876 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:31.876 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:31.876 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:31.876 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:31.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:31.876 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:31.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:31.877 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:31.877 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:31.877 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:31.877 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:31.877 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:31.877 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:31.878 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:31.878 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:31.878 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:31.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:31.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:31.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:31.878 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:31.879 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:31.879 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:31.879 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:31.879 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:31.879 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:31.879 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:31.879 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:31.880 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:31.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:31.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:31.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:31.880 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:31.880 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:31.880 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:31.880 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:31.881 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:31.881 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:31.881 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:31.881 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:31.881 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:31.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:31.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:31.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:31.882 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:31.882 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:31.882 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:31.882 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:31.882 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:31.882 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:31.883 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:31.883 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:31.883 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:31.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:31.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:31.883 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:31.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:31.884 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:31.884 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:31.884 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:31.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:31.884 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:31.885 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:58:36.886 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:36.887 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:36.888 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:36.928 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:36.929 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:37.189 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:37.189 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:37.189 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:37.190 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:37.190 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:37.190 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:37.190 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:37.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:37.190 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:37.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:37.191 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:37.191 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:37.191 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:37.191 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:37.191 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:37.191 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:37.192 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:37.192 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:37.192 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:37.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:37.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:37.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:37.192 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:37.193 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:37.193 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:37.193 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:37.193 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:37.193 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:37.193 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:37.193 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:37.194 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:37.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:37.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:37.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:37.194 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:37.194 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:37.194 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:37.194 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:37.195 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:37.195 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:37.195 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:37.195 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:37.195 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:37.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:37.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:37.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:37.196 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:37.196 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:37.196 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:37.196 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:37.196 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:37.196 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:37.197 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:37.197 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:37.197 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:37.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:37.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:37.197 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:37.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:37.197 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:37.198 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:37.198 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:37.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:37.198 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:37.199 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:58:42.200 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:42.200 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:42.201 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:42.473 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:42.473 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:42.473 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:42.473 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:42.474 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:42.474 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:42.474 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:42.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:42.474 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:42.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:42.474 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:42.475 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:42.475 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:42.475 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:42.475 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:42.475 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:42.475 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:42.475 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:42.476 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:42.476 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:42.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:42.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:42.476 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:42.476 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:42.476 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:42.477 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:42.477 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:42.477 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:42.477 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:42.477 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:42.477 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:42.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:42.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:42.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:42.478 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:42.478 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:42.478 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:42.478 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:42.478 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:42.478 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:42.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:42.479 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:42.479 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:42.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:42.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:42.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:42.479 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:42.480 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:42.480 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:42.480 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:42.480 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:42.480 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:42.480 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:42.480 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:42.481 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:42.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:42.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:42.481 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:42.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:42.481 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:42.481 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:42.481 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:42.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:42.482 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:42.483 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1601899010.531704_48.1 target= 2020-10-05T11:58:47.484 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:47.485 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:47.485 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:47.806 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:58:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:47.816 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:47.817 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T11:58:47.818 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T11:58:47.818 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:47.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:47.819 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:47.863 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:47.864 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:48.125 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:58:48.125 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T11:58:48.125 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T11:58:48.126 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T11:58:48.126 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T11:58:48.126 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:48.126 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:48.126 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:48.126 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T11:58:48.127 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:48.127 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T11:58:48.127 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:48.127 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:48.127 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:48.127 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:48.128 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T11:58:48.128 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:48.128 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:58:48.128 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:48.128 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:48.128 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:48.128 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:48.129 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T11:58:48.129 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:48.129 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:48.129 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:48.129 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:48.129 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:58:48.129 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:48.130 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:58:48.130 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:48.130 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:48.130 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:48.130 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:48.130 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T11:58:48.131 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:48.131 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:48.131 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:48.131 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:48.131 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:58:48.131 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:48.131 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:58:48.132 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:48.132 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:48.132 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:48.132 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:48.132 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T11:58:48.132 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:48.132 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:48.133 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:48.133 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:48.133 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:58:48.133 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:48.133 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:58:48.133 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:48.133 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:48.134 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:48.134 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T11:58:48.134 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:48.134 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T11:58:48.135 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T11:58:48.135 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T11:58:48.135 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:48.135 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:58:48.136 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T11:58:48.137 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T11:58:48.137 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:48.138 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:48.138 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:48.450 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:48.450 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:58:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:48.454 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:48.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:48.456 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:48.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:48.458 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:48.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:48.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:48.460 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:48.461 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T11:58:48.462 INFO:rgw_multi.tests:meta checkpoint 2020-10-05T11:58:48.462 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:48.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:48.463 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:48.503 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:48.503 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:48.716 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T11:58:48.748 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T11:58:48.748 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:48.749 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:48.749 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:56:50.531704Z" 2020-10-05T11:58:48.749 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:48.749 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:48.749 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:48.750 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:58:48.750 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:48.750 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:48.750 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:48.750 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:58:48.750 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:48.751 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:48.751 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:48.751 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:58:48.751 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:48.751 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T11:58:48.752 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T11:58:48.753 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:48.753 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:48.753 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:49.030 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:58:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:49.040 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:49.041 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T11:58:49.042 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T11:58:49.042 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:49.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:49.043 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:49.082 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:49.082 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:49.315 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:58:49.316 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T11:58:49.316 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T11:58:49.316 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T11:58:49.316 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T11:58:49.316 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:49.317 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:49.317 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:49.317 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T11:58:49.317 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:49.317 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T11:58:49.317 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:49.317 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:49.318 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:49.318 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:49.318 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T11:58:49.318 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:49.318 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:58:49.318 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:49.319 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:49.319 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:49.319 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:49.319 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T11:58:49.319 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:49.319 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:49.320 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:49.320 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:49.320 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:58:49.320 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:49.320 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:58:49.320 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:49.320 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:49.321 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:49.321 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:49.321 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T11:58:49.321 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:49.321 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:49.321 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:49.322 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:49.322 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:58:49.322 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:49.322 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:58:49.322 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:49.322 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:49.322 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:49.323 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:49.323 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T11:58:49.323 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:49.323 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:49.323 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:49.323 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:49.323 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:58:49.324 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:49.324 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:58:49.324 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:49.324 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:49.324 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:49.324 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T11:58:49.325 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:49.325 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T11:58:49.325 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T11:58:49.325 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T11:58:49.325 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:49.325 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:58:49.326 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T11:58:49.327 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T11:58:49.327 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:49.327 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:49.328 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:49.365 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:49.366 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:49.635 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:49.636 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:49.637 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:58:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:49.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:49.640 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:49.641 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:49.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:49.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:49.644 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:49.645 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T11:58:49.646 INFO:tasks.rgw_multisite_tests:running rgw multisite tests on 'tasks.rgw_multi.tests' with args=[] 2020-10-05T11:58:49.654 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-1 2020-10-05T11:58:53.331 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-2 2020-10-05T11:58:56.666 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=dzadif-3 2020-10-05T11:58:56.732 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:56.733 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:56.733 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:56.768 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:56.769 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:56.975 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T11:58:57.011 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T11:58:57.012 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:57.012 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:57.012 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:56:50.531704Z" 2020-10-05T11:58:57.012 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:57.013 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:57.013 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899136.712011_63.1", 2020-10-05T11:58:57.013 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:58:56.712011Z" 2020-10-05T11:58:57.013 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:57.013 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:57.013 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:57.013 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:58:57.014 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:57.014 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:57.014 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:57.014 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:58:57.014 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:57.014 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T11:58:57.015 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T11:58:57.016 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:57.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:57.017 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:57.057 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:57.057 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:57.318 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:57.319 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:57.319 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:57.319 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:57.319 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:57.319 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:57.320 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:57.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:57.320 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:57.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:57.320 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:57.320 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:57.320 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:57.321 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:57.321 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:57.321 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:57.321 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:57.321 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:58:57.321 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:57.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:57.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:57.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:57.322 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:57.322 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:57.322 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:57.322 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899136.712011_63.1", 2020-10-05T11:58:57.322 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:57.323 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:57.323 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:57.323 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:56.712011Z", 2020-10-05T11:58:57.323 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:57.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:57.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:57.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:57.324 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:57.324 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:57.324 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:57.324 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:57.324 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:57.324 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:57.324 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:57.326 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:57.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:57.328 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:57.328 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T11:58:57.329 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T11:58:57.329 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:57.330 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:57.330 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:57.366 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:57.366 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:57.601 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:58:57.601 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T11:58:57.602 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T11:58:57.602 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T11:58:57.602 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T11:58:57.602 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:57.602 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:57.602 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:57.603 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T11:58:57.603 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:57.603 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T11:58:57.603 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:57.603 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:57.603 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:57.603 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:57.604 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T11:58:57.604 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:57.604 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:58:57.604 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:57.604 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:57.604 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:57.604 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:57.605 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T11:58:57.605 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:57.605 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:57.605 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899136.712011_63.1", 2020-10-05T11:58:57.605 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:57.605 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:58:57.605 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:57.606 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:56.712011Z", 2020-10-05T11:58:57.606 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:57.606 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:57.606 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:57.606 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:57.606 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T11:58:57.606 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:57.607 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:57.607 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:57.607 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:57.607 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:58:57.607 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:57.607 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:58:57.607 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:57.607 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:57.608 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:57.608 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:57.608 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T11:58:57.608 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:57.608 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:57.608 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:57.608 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:57.609 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:58:57.609 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:57.609 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:58:57.609 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:57.609 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:57.609 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:57.609 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T11:58:57.610 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:57.610 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T11:58:57.610 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T11:58:57.610 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T11:58:57.610 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:57.610 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:58:57.611 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T11:58:57.612 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T11:58:57.612 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:57.612 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:57.613 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:57.911 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:57.912 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:57.912 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:57.912 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:57.912 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:57.913 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:57.913 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:57.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:57.913 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:57.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:57.914 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:57.914 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:57.915 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:57.915 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:57.915 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:57.915 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:57.915 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:57.915 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:58:57.915 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:57.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:57.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:57.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:57.916 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:57.916 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:57.916 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:57.916 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899136.712011_63.1", 2020-10-05T11:58:57.917 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:57.917 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:57.917 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:57.917 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:56.712011Z", 2020-10-05T11:58:57.917 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:57.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:57.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:57.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:57.918 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:57.918 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:57.918 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:57.918 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:57.918 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:57.918 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:57.919 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:57.919 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:57.919 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:57.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:57.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:57.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:57.919 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:57.920 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:57.920 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:57.920 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:57.920 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:57.920 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:57.920 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:57.920 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:57.920 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:57.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:57.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:57.921 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:57.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:57.921 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:57.921 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:57.921 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:57.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:57.922 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:57.923 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T11:58:57.963 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_create ... ok 2020-10-05T11:58:57.965 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-4 2020-10-05T11:58:57.991 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-5 2020-10-05T11:58:58.040 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=dzadif-6 2020-10-05T11:58:58.097 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:58.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:58.099 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:58.134 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:58.134 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:58.334 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T11:58:58.371 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T11:58:58.372 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:58.372 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:58.372 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:56:50.531704Z" 2020-10-05T11:58:58.372 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:58.372 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:58.372 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899138.076875_78.1", 2020-10-05T11:58:58.372 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:58:58.076875Z" 2020-10-05T11:58:58.373 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:58.373 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:58.373 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:58.373 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:58:58.373 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:58.373 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:58.373 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:58.374 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:58:58.374 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:58.374 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T11:58:58.375 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T11:58:58.375 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:58.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:58.376 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:58.417 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:58.417 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:58.638 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:58.638 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:58.638 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:58.638 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:58.638 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:58.639 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:58.639 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:58.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:58.639 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:58.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:58.639 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:58.639 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:58.640 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:58.640 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:58.640 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:58.640 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:58.640 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:58.640 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:58:58.640 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:58.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:58.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:58.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:58.641 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:58.641 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:58.641 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:58.641 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899138.076875_78.1", 2020-10-05T11:58:58.642 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:58.642 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:58.642 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:58.642 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.076875Z", 2020-10-05T11:58:58.642 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:58.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:58.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:58.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:58.643 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:58.643 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:58.643 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:58.643 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:58.643 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:58.643 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:58.643 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:58.644 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:58.644 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:58.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:58.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:58.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:58.644 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:58.644 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:58.645 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:58.645 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:58.645 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:58.645 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:58.645 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:58.645 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:58.645 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:58.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:58.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:58.646 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:58.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:58.646 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:58.646 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:58.646 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:58.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:58.647 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:58.648 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T11:58:58.648 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T11:58:58.648 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:58.649 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:58.649 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:58.691 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:58.691 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:58.942 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:58:58.943 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T11:58:58.943 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T11:58:58.943 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T11:58:58.943 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T11:58:58.943 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:58.943 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:58.944 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:58.944 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T11:58:58.944 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:58.944 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T11:58:58.944 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:58.944 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:58.944 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:58.945 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:58.945 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T11:58:58.945 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:58.945 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:58:58.945 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:58.945 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:58.945 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:58.946 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:58.946 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T11:58:58.946 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:58.946 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:58.946 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899138.076875_78.1", 2020-10-05T11:58:58.946 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:58.946 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:58:58.947 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:58.947 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.076875Z", 2020-10-05T11:58:58.947 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:58.947 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:58.947 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:58.947 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:58.947 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T11:58:58.948 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:58.948 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:58.948 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:58.948 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:58.948 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:58:58.948 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:58.948 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:58:58.949 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:58.949 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:58.949 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:58.949 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:58.949 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T11:58:58.949 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:58:58.949 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:58:58.949 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:58.950 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:58:58.950 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:58:58.950 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:58:58.950 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:58:58.950 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:58:58.950 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:58.950 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:58.951 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T11:58:58.951 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:58.951 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T11:58:58.951 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T11:58:58.951 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T11:58:58.951 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:58.951 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:58:58.952 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T11:58:58.953 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T11:58:58.953 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:58.953 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:58.954 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:58.994 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:58.995 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:59.362 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:58:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:58:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:58:59.362 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:58:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:58:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:58:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:58:59.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:58:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:58:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:59.364 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:58:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:58:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:59.365 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899138.076875_78.1", 2020-10-05T11:58:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.076875Z", 2020-10-05T11:58:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:59.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:58:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:59.367 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:59.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:58:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:58:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:58:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:58:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:58:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:58:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:58:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:58:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:58:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:58:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:58:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:58:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:58:59.370 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:58:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:58:59.371 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:58:59.371 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:58:59.372 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T11:58:59.721 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:59.721 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:59.722 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:58:59.754 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:58:59.754 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:58:59.963 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T11:58:59.994 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T11:58:59.994 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:59.994 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:58:59.994 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:56:50.531704Z" 2020-10-05T11:58:59.995 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:59.995 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:59.995 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899138.076875_78.1", 2020-10-05T11:58:59.995 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:58:58.076875Z" 2020-10-05T11:58:59.995 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:59.995 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:59.995 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:59.996 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:58:59.996 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:58:59.996 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:58:59.996 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:58:59.996 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:58:59.996 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:58:59.996 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T11:58:59.997 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T11:58:59.998 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:59.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:58:59.999 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:00.041 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:00.041 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:00.258 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:59:00.258 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:59:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:59:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:59:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:59:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:00.260 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:59:00.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:00.260 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:59:00.260 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:00.260 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:00.260 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:59:00.261 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:00.261 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:59:00.261 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:00.261 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:59:00.261 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:00.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:00.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:00.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:00.262 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:59:00.263 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:00.263 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:00.263 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899138.076875_78.1", 2020-10-05T11:59:00.263 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:00.263 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:00.263 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:00.263 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.076875Z", 2020-10-05T11:59:00.264 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:00.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:00.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:00.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:00.264 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:59:00.264 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:00.264 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:00.265 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:00.265 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:00.265 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:00.265 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:00.265 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:00.265 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:00.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:00.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:00.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:00.266 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:59:00.266 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:00.266 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:00.266 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:00.266 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:00.267 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:00.267 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:00.267 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:00.267 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:00.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:00.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:00.267 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:59:00.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:00.268 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:59:00.268 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:59:00.268 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:59:00.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:00.268 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:59:00.269 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T11:59:00.270 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T11:59:00.270 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:00.270 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:00.271 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:00.312 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:00.312 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:00.552 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:59:00.552 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T11:59:00.552 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T11:59:00.553 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T11:59:00.553 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T11:59:00.553 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:00.553 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:00.553 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:00.553 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T11:59:00.553 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:00.554 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T11:59:00.554 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:00.554 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:00.554 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:59:00.554 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:00.554 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T11:59:00.554 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:00.555 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:59:00.555 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:00.555 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:00.555 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:00.555 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:00.555 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T11:59:00.555 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:00.556 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:00.556 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899138.076875_78.1", 2020-10-05T11:59:00.556 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:00.556 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:00.556 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:00.556 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.076875Z", 2020-10-05T11:59:00.556 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:00.557 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:00.557 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:00.557 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:00.557 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T11:59:00.557 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:00.557 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:00.557 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:00.558 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:00.558 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:00.558 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:00.558 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:59:00.558 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:00.558 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:00.558 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:00.559 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:00.559 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T11:59:00.559 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:00.559 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:00.559 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:00.559 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:00.559 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:00.559 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:00.560 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:59:00.560 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:00.560 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:00.560 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:00.560 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T11:59:00.560 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:00.560 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T11:59:00.561 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T11:59:00.561 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T11:59:00.561 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:00.561 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:59:00.562 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T11:59:00.562 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T11:59:00.563 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:00.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:00.563 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:00.858 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:59:00.859 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:59:00.859 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:59:00.859 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:59:00.859 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:59:00.859 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:00.860 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:00.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:00.860 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:59:00.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:00.860 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:59:00.860 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:00.860 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:00.861 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:59:00.861 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:00.861 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:59:00.861 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:00.861 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:59:00.861 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:00.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:00.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:00.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:00.862 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:59:00.862 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:00.862 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:00.862 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899138.076875_78.1", 2020-10-05T11:59:00.862 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:00.863 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:00.863 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:00.863 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.076875Z", 2020-10-05T11:59:00.863 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:00.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:00.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:00.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:00.864 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:59:00.864 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:00.864 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:00.864 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:00.864 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:00.864 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:00.864 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:00.865 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:00.865 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:00.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:00.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:00.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:00.865 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:59:00.865 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:00.866 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:00.866 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:00.866 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:00.866 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:00.866 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:00.866 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:00.866 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:00.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:00.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:00.867 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:59:00.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:00.867 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:59:00.867 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:59:00.867 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:59:00.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:00.868 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:59:00.868 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T11:59:00.910 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_recreate ... ok 2020-10-05T11:59:00.911 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-7 2020-10-05T11:59:00.941 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-8 2020-10-05T11:59:00.997 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=dzadif-9 2020-10-05T11:59:01.057 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:01.058 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:01.059 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:01.094 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:01.095 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:01.327 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T11:59:01.358 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T11:59:01.358 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:01.358 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:59:01.358 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:56:50.531704Z" 2020-10-05T11:59:01.358 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:01.359 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:01.359 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899141.037160_94.1", 2020-10-05T11:59:01.359 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:01.037160Z" 2020-10-05T11:59:01.359 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:01.359 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:01.359 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:01.359 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:59:01.360 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:01.360 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:01.360 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:01.360 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:59:01.360 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:01.360 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T11:59:01.361 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T11:59:01.362 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:01.362 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:01.362 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:01.401 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:01.402 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:01.660 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:59:01.660 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:59:01.661 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:59:01.661 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:59:01.661 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:59:01.661 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:01.661 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:01.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:01.661 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:59:01.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:01.662 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:59:01.662 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:01.662 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:01.662 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:59:01.662 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:01.662 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:59:01.663 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:01.663 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:59:01.663 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:01.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:01.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:01.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:01.663 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:59:01.664 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:01.664 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:01.664 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899141.037160_94.1", 2020-10-05T11:59:01.664 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:01.664 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:01.664 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:01.664 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:01.037160Z", 2020-10-05T11:59:01.664 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:01.665 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:01.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:01.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:01.665 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:59:01.665 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:01.665 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:01.665 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:01.666 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:01.666 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:01.666 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:01.666 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:01.666 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:01.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:01.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:01.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:01.667 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:59:01.667 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:01.667 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:01.667 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:01.667 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:01.667 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:01.668 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:01.668 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:01.668 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:01.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:01.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:01.668 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:59:01.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:01.668 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:59:01.669 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:59:01.669 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:59:01.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:01.669 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:59:01.670 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T11:59:01.670 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T11:59:01.671 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:01.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:01.672 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:01.712 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:01.712 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:01.966 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:59:01.967 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T11:59:01.967 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T11:59:01.967 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T11:59:01.967 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T11:59:01.967 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:01.967 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:01.968 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:01.968 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T11:59:01.968 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:01.968 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T11:59:01.968 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:01.968 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:01.969 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:59:01.969 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:01.969 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T11:59:01.969 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:01.969 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:59:01.969 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:01.969 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:01.970 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:01.970 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:01.970 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T11:59:01.970 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:01.970 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:01.970 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899141.037160_94.1", 2020-10-05T11:59:01.971 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:01.971 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:01.971 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:01.971 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:01.037160Z", 2020-10-05T11:59:01.971 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:01.971 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:01.971 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:01.972 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:01.972 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T11:59:01.972 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:01.972 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:01.972 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:01.972 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:01.972 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:01.973 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:01.973 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:59:01.973 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:01.973 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:01.973 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:01.973 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:01.973 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T11:59:01.974 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:01.974 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:01.974 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:01.974 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:01.974 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:01.974 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:01.974 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:59:01.975 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:01.975 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:01.975 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:01.975 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T11:59:01.975 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:01.975 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T11:59:01.975 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T11:59:01.976 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T11:59:01.976 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:01.976 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:59:01.977 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T11:59:01.977 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T11:59:01.978 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:01.978 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:01.979 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:02.017 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:02.018 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:02.287 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:59:02.287 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:59:02.287 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:59:02.288 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:59:02.288 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:59:02.288 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:02.288 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:02.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:02.288 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:59:02.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:02.289 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:59:02.289 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:02.289 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:02.289 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:59:02.289 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:02.289 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:59:02.289 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:02.290 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:59:02.290 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:02.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:02.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:02.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:02.290 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:59:02.290 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:02.291 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:02.291 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899141.037160_94.1", 2020-10-05T11:59:02.291 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:02.291 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:02.291 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:02.291 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:01.037160Z", 2020-10-05T11:59:02.291 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:02.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:02.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:02.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:02.292 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:59:02.292 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:02.292 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:02.293 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:02.293 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:02.293 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:02.293 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:02.293 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:02.293 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:02.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:02.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:02.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:02.294 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:59:02.294 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:02.294 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:02.294 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:02.294 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:02.295 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:02.295 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:02.295 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:02.295 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:02.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:02.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:02.295 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:59:02.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:02.296 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:59:02.296 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:59:02.296 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:59:02.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:02.296 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:59:02.297 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T11:59:02.573 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:02.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:02.574 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:02.605 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:02.605 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:02.822 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T11:59:02.854 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T11:59:02.855 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:02.855 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:59:02.855 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:56:50.531704Z" 2020-10-05T11:59:02.855 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:02.855 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:02.856 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T11:59:02.856 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:02.535244Z" 2020-10-05T11:59:02.856 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:02.856 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:02.856 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:02.856 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:59:02.857 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:02.857 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:02.857 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:02.857 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:59:02.857 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:02.857 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T11:59:02.858 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T11:59:02.859 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:02.859 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:02.860 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:02.900 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:02.900 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:03.168 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:59:03.168 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:59:03.168 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:59:03.169 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:59:03.169 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:59:03.169 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:03.169 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:03.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:03.169 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:59:03.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:03.170 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:59:03.170 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:03.170 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:03.170 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:59:03.170 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:03.170 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:59:03.170 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:03.171 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:59:03.171 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:03.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:03.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:03.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:03.171 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:59:03.171 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:03.172 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:03.172 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T11:59:03.172 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:03.172 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:03.172 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:03.172 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T11:59:03.172 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:03.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:03.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:03.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:03.173 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:59:03.173 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:03.173 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:03.173 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:03.173 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:03.174 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:03.174 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:03.174 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:03.174 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:03.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:03.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:03.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:03.175 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:59:03.175 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:03.175 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:03.175 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:03.175 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:03.175 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:03.175 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:03.176 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:03.176 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:03.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:03.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:03.176 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:59:03.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:03.176 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:59:03.177 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:59:03.177 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:59:03.177 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:03.177 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:59:03.178 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T11:59:03.178 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T11:59:03.179 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:03.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:03.179 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:03.218 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:03.219 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:03.450 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:59:03.450 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T11:59:03.451 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T11:59:03.451 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T11:59:03.451 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T11:59:03.451 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:03.451 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:03.451 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:03.451 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T11:59:03.452 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:03.452 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T11:59:03.452 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:03.452 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:03.452 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:59:03.452 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:03.452 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T11:59:03.453 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:03.453 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:59:03.453 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:03.453 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:03.453 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:03.453 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:03.453 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T11:59:03.454 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:03.454 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:03.454 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T11:59:03.454 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:03.454 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:03.454 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:03.454 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T11:59:03.455 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:03.455 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:03.455 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:03.455 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:03.455 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T11:59:03.455 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:03.455 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:03.456 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:03.456 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:03.456 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:03.456 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:03.456 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:59:03.456 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:03.456 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:03.456 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:03.457 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:03.457 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T11:59:03.457 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:03.457 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:03.457 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:03.457 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:03.458 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:03.458 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:03.458 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:59:03.458 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:03.458 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:03.458 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:03.458 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T11:59:03.459 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:03.459 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T11:59:03.459 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T11:59:03.460 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T11:59:03.460 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:03.460 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:59:03.461 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T11:59:03.461 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T11:59:03.462 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:03.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:03.462 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:03.502 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:03.771 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:59:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:59:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:59:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:59:03.771 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:59:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:59:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:59:03.772 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899010.531704_48.1", 2020-10-05T11:59:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:59:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704Z", 2020-10-05T11:59:03.773 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:59:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:03.774 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T11:59:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T11:59:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:03.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:59:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:03.776 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:59:03.777 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:03.778 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:59:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:59:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:59:03.779 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:59:03.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:03.780 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:59:03.781 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T11:59:03.795 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_remove ... ok 2020-10-05T11:59:03.796 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-10 2020-10-05T11:59:03.835 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-11 2020-10-05T11:59:03.893 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=dzadif-12 2020-10-05T11:59:03.971 INFO:tasks.rgw.c1.client.1.smithi158.stdout:2020-10-05T11:59:03.971+0000 7fdf3e7fc700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2020-10-05T11:59:03.973 INFO:tasks.rgw.c2.client.0.smithi081.stdout:2020-10-05T11:59:03.976+0000 7fe951ff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2020-10-05T11:59:03.975 INFO:tasks.rgw.c2.client.1.smithi081.stdout:2020-10-05T11:59:03.976+0000 7f3ec5feb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2020-10-05T11:59:04.526 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:04.527 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:04.527 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:04.561 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:04.562 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:04.784 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T11:59:04.805 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T11:59:04.805 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:04.806 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899143.924911_68.1", 2020-10-05T11:59:04.806 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:03.924911Z" 2020-10-05T11:59:04.806 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:04.806 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:04.806 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T11:59:04.806 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:02.535244Z" 2020-10-05T11:59:04.807 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:04.807 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:04.807 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:04.807 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:59:04.807 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:04.807 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:04.807 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:04.808 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:59:04.808 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:04.808 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T11:59:04.809 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T11:59:04.809 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:04.810 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:04.810 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:04.854 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:04.854 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:05.070 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:59:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:59:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:59:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:59:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:59:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:59:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:59:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899143.924911_68.1", 2020-10-05T11:59:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:59:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.924911Z", 2020-10-05T11:59:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:59:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T11:59:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T11:59:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:59:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:59:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:59:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:59:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:59:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:59:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:05.079 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:59:05.080 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T11:59:05.081 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T11:59:05.081 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:05.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:05.082 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:05.119 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:05.119 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:05.348 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:59:05.349 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T11:59:05.349 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T11:59:05.349 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T11:59:05.349 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T11:59:05.350 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:05.350 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:05.350 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:05.350 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T11:59:05.350 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:05.350 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T11:59:05.350 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:05.351 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:05.351 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899143.924911_68.1", 2020-10-05T11:59:05.351 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:05.351 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T11:59:05.351 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:05.351 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.924911Z", 2020-10-05T11:59:05.351 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:05.352 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:05.352 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:05.352 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:05.352 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T11:59:05.352 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:05.352 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:05.352 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T11:59:05.353 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:05.353 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:05.353 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:05.353 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T11:59:05.353 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:05.353 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:05.353 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:05.354 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:05.354 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T11:59:05.354 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:05.354 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:05.354 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:05.354 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:05.354 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:05.355 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:05.355 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:59:05.355 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:05.355 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:05.355 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:05.355 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:05.355 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T11:59:05.355 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:05.356 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:05.356 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:05.356 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:05.356 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:05.356 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:05.356 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:59:05.356 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:05.357 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:05.357 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:05.357 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T11:59:05.357 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:05.357 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T11:59:05.357 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T11:59:05.357 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T11:59:05.358 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:05.358 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:59:05.359 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T11:59:05.359 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T11:59:05.360 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:05.360 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:05.360 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:05.399 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:05.399 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:05.661 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:59:05.662 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:59:05.662 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:59:05.662 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:59:05.662 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:59:05.662 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:05.662 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:05.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:05.663 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:59:05.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:05.663 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:59:05.663 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:05.664 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:05.664 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899143.924911_68.1", 2020-10-05T11:59:05.664 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:05.664 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:59:05.664 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:05.665 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.924911Z", 2020-10-05T11:59:05.665 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:05.665 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:05.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:05.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:05.665 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:59:05.665 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:05.666 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:05.666 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T11:59:05.666 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:05.666 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:05.666 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:05.666 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T11:59:05.666 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:05.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:05.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:05.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:05.667 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:59:05.667 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:05.667 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:05.667 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:05.667 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:05.668 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:05.668 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:05.668 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:05.668 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:05.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:05.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:05.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:05.669 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:59:05.669 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:05.669 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:05.669 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:05.669 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:05.669 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:05.669 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:05.670 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:05.670 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:05.670 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:05.670 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:05.670 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:59:05.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:05.670 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:59:05.670 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:59:05.671 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:59:05.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:05.671 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:59:05.672 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T11:59:05.672 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-10', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:05.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-10', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:05.673 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-10 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:05.763 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:05.992 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:05.992+0000 7fed03dbc0c0 1 bucket sync caught up with source: 2020-10-05T11:59:05.992 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000001.5.5, , 00000000001.6.5, , , , 00000000001.6.5, 00000000001.5.5, , ] 2020-10-05T11:59:05.992 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000001.5.5, , 00000000001.6.5, , , , 00000000001.6.5, 00000000001.5.5, , ] 2020-10-05T11:59:05.992 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:05.992+0000 7fed03dbc0c0 0 bucket checkpoint complete 2020-10-05T11:59:06.023 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-10 zones={test-zone2, test-zone1} 2020-10-05T11:59:06.034 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T11:59:06.040 DEBUG:tasks.rgw_multi.zone_rados:o=& 2020-10-05T11:59:06.041 DEBUG:tasks.rgw_multi.zone_rados:o=: 2020-10-05T11:59:06.041 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2020-10-05T11:59:06.041 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:06.042 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T11:59:06.047 DEBUG:tasks.rgw_multi.zone_rados:o=& 2020-10-05T11:59:06.048 DEBUG:tasks.rgw_multi.zone_rados:o=: 2020-10-05T11:59:06.048 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2020-10-05T11:59:06.048 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:06.059 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:06.109 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:06.218 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:06.324 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:06.380 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:06.490 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:06.597 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:06.651 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:06.767 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:06.869 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:06.923 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:07.034 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:07.138 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-10 zones={test-zone2, test-zone1} 2020-10-05T11:59:07.138 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-10', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:07.139 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-10', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:07.139 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-10 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:07.182 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:07.182 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:07.392 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:07.391+0000 7f5286dec0c0 1 bucket sync caught up with source: 2020-10-05T11:59:07.392 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000001.5.5, , 00000000001.6.5, , , , 00000000001.6.5, 00000000001.5.5, , ] 2020-10-05T11:59:07.392 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000001.5.5, , 00000000001.6.5, , , , 00000000001.6.5, 00000000001.5.5, , ] 2020-10-05T11:59:07.393 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:07.391+0000 7f5286dec0c0 0 bucket checkpoint complete 2020-10-05T11:59:07.418 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-10 zones={test-zone3, test-zone1} 2020-10-05T11:59:07.427 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T11:59:07.433 DEBUG:tasks.rgw_multi.zone_rados:o=& 2020-10-05T11:59:07.433 DEBUG:tasks.rgw_multi.zone_rados:o=: 2020-10-05T11:59:07.434 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2020-10-05T11:59:07.434 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:07.434 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T11:59:07.438 DEBUG:tasks.rgw_multi.zone_rados:o=& 2020-10-05T11:59:07.439 DEBUG:tasks.rgw_multi.zone_rados:o=: 2020-10-05T11:59:07.439 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2020-10-05T11:59:07.439 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:07.448 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:07.503 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:07.611 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:07.713 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:07.766 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:07.877 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:07.981 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:08.034 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:08.142 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:08.245 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:08.297 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:08.401 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:08.505 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-10 zones={test-zone3, test-zone1} 2020-10-05T11:59:08.505 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-10', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:08.506 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-10', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:08.506 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-10 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:08.552 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:08.552 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:08.786 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:08.788+0000 7f7e95b770c0 1 bucket sync caught up with source: 2020-10-05T11:59:08.786 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000001.5.5, , 00000000001.6.5, , , , 00000000001.6.5, 00000000001.5.5, , ] 2020-10-05T11:59:08.787 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000001.5.5, , 00000000001.6.5, , , , 00000000001.6.5, 00000000001.5.5, , ] 2020-10-05T11:59:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:08.788+0000 7f7e95b770c0 0 bucket checkpoint complete 2020-10-05T11:59:08.919 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-11', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:08.920 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-11', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:08.920 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-11 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:08.967 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:08.968 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:09.203 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:09.203+0000 7ffb989a10c0 1 bucket sync caught up with source: 2020-10-05T11:59:09.203 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000001.7.5, , 00000000001.11.5, , , , 00000000001.6.5, 00000000001.12.5, , ] 2020-10-05T11:59:09.204 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000001.7.5, , 00000000001.11.5, , , , 00000000001.6.5, 00000000001.12.5, , ] 2020-10-05T11:59:09.204 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:09.203+0000 7ffb989a10c0 0 bucket checkpoint complete 2020-10-05T11:59:09.237 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-11 zones={test-zone1, test-zone2} 2020-10-05T11:59:09.248 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T11:59:09.257 DEBUG:tasks.rgw_multi.zone_rados:o=& 2020-10-05T11:59:09.258 DEBUG:tasks.rgw_multi.zone_rados:o=: 2020-10-05T11:59:09.258 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2020-10-05T11:59:09.259 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:09.259 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T11:59:09.265 DEBUG:tasks.rgw_multi.zone_rados:o=& 2020-10-05T11:59:09.266 DEBUG:tasks.rgw_multi.zone_rados:o=: 2020-10-05T11:59:09.266 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2020-10-05T11:59:09.266 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:09.275 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:09.326 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:09.435 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:09.545 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:09.598 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:09.706 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:09.809 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:09.867 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:09.979 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:10.093 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:10.151 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:10.267 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:10.377 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-11 zones={test-zone1, test-zone2} 2020-10-05T11:59:10.378 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-11', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:10.378 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-11', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:10.379 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-11 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:10.426 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:10.426 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:10.668 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:10.667+0000 7f10e29ef0c0 1 bucket sync caught up with source: 2020-10-05T11:59:10.668 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000001.7.5, , 00000000001.11.5, , , , 00000000001.6.5, 00000000001.12.5, , ] 2020-10-05T11:59:10.668 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000001.7.5, , 00000000001.11.5, , , , 00000000001.6.5, 00000000001.12.5, , ] 2020-10-05T11:59:10.668 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:10.667+0000 7f10e29ef0c0 0 bucket checkpoint complete 2020-10-05T11:59:10.698 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-11 zones={test-zone3, test-zone2} 2020-10-05T11:59:10.707 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T11:59:10.713 DEBUG:tasks.rgw_multi.zone_rados:o=& 2020-10-05T11:59:10.713 DEBUG:tasks.rgw_multi.zone_rados:o=: 2020-10-05T11:59:10.714 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2020-10-05T11:59:10.714 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:10.714 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T11:59:10.719 DEBUG:tasks.rgw_multi.zone_rados:o=& 2020-10-05T11:59:10.720 DEBUG:tasks.rgw_multi.zone_rados:o=: 2020-10-05T11:59:10.720 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2020-10-05T11:59:10.720 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:10.730 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:10.782 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:10.895 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:11.005 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:11.063 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:11.175 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:11.281 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:11.334 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:11.446 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:11.549 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:11.605 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:11.714 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:11.817 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-11 zones={test-zone3, test-zone2} 2020-10-05T11:59:11.818 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-12', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:11.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-12', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:11.819 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-12 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:11.866 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:11.867 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:12.089 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:12.087+0000 7fd2f90af0c0 1 bucket sync caught up with source: 2020-10-05T11:59:12.089 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000001.10.5, , 00000000001.12.5, , , , 00000000001.8.5, 00000000001.13.5, , ] 2020-10-05T11:59:12.090 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000001.10.5, , 00000000001.12.5, , , , 00000000001.8.5, 00000000001.13.5, , ] 2020-10-05T11:59:12.090 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:12.087+0000 7fd2f90af0c0 0 bucket checkpoint complete 2020-10-05T11:59:12.114 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-12 zones={test-zone1, test-zone3} 2020-10-05T11:59:12.122 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T11:59:12.128 DEBUG:tasks.rgw_multi.zone_rados:o=& 2020-10-05T11:59:12.128 DEBUG:tasks.rgw_multi.zone_rados:o=: 2020-10-05T11:59:12.128 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2020-10-05T11:59:12.129 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:12.129 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T11:59:12.134 DEBUG:tasks.rgw_multi.zone_rados:o=& 2020-10-05T11:59:12.134 DEBUG:tasks.rgw_multi.zone_rados:o=: 2020-10-05T11:59:12.134 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2020-10-05T11:59:12.135 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:12.143 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:12.200 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:12.309 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:12.413 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:12.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:12.577 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:12.680 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:12.735 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:12.845 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:12.947 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:12.999 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:13.110 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:13.254 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-12 zones={test-zone1, test-zone3} 2020-10-05T11:59:13.255 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-12', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:13.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-12', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:13.256 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-12 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:13.302 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:13.302 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:13.536+0000 7f6666be40c0 1 bucket sync caught up with source: 2020-10-05T11:59:13.535 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000001.10.5, , 00000000001.12.5, , , , 00000000001.8.5, 00000000001.13.5, , ] 2020-10-05T11:59:13.535 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000001.10.5, , 00000000001.12.5, , , , 00000000001.8.5, 00000000001.13.5, , ] 2020-10-05T11:59:13.535 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:13.536+0000 7f6666be40c0 0 bucket checkpoint complete 2020-10-05T11:59:13.566 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-12 zones={test-zone2, test-zone3} 2020-10-05T11:59:13.584 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T11:59:13.590 DEBUG:tasks.rgw_multi.zone_rados:o=& 2020-10-05T11:59:13.591 DEBUG:tasks.rgw_multi.zone_rados:o=: 2020-10-05T11:59:13.591 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2020-10-05T11:59:13.592 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:13.592 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T11:59:13.598 DEBUG:tasks.rgw_multi.zone_rados:o=& 2020-10-05T11:59:13.598 DEBUG:tasks.rgw_multi.zone_rados:o=: 2020-10-05T11:59:13.599 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2020-10-05T11:59:13.599 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:13.611 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:13.667 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:13.782 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2020-10-05T11:59:13.886 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:13.938 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:14.051 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2020-10-05T11:59:14.157 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:14.210 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:14.323 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2020-10-05T11:59:14.425 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:14.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:14.589 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:14.689 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-12 zones={test-zone2, test-zone3} 2020-10-05T11:59:14.690 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_object_sync ... ok 2020-10-05T11:59:14.690 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-13 2020-10-05T11:59:14.716 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-14 2020-10-05T11:59:14.777 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=dzadif-15 2020-10-05T11:59:14.977 INFO:tasks.rgw.c2.client.0.smithi081.stdout:2020-10-05T11:59:14.976+0000 7fe9527f4700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2020-10-05T11:59:14.994 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:14.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:14.995 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:15.036 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:15.036 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:15.224 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T11:59:15.259 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T11:59:15.260 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:15.260 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899154.815329_180.1", 2020-10-05T11:59:15.260 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:14.815329Z" 2020-10-05T11:59:15.261 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:15.261 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:15.261 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T11:59:15.261 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:02.535244Z" 2020-10-05T11:59:15.262 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:15.262 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:15.262 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:15.263 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:59:15.263 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:15.263 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:15.263 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:15.264 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T11:59:15.264 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:15.264 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T11:59:15.265 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T11:59:15.266 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:15.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:15.268 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:15.534 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:59:15.534 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:59:15.534 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:59:15.534 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:59:15.535 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:59:15.535 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:15.535 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:15.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:15.535 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:59:15.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:15.536 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:59:15.536 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:15.536 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:15.536 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899154.815329_180.1", 2020-10-05T11:59:15.536 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:15.536 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:59:15.536 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:15.537 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.815329Z", 2020-10-05T11:59:15.537 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:15.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:15.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:15.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:15.537 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:59:15.538 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:15.538 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:15.538 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T11:59:15.538 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:15.538 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:15.538 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:15.538 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T11:59:15.539 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:15.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:15.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:15.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:15.539 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:59:15.539 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:15.540 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:15.540 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:15.540 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:15.540 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:15.540 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:15.540 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:15.540 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:15.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:15.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:15.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:15.541 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:59:15.541 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:15.541 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:15.541 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:15.542 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:15.542 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:15.542 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:15.542 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:15.542 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:15.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:15.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:15.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:59:15.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:15.543 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:59:15.543 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:59:15.543 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:59:15.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:15.544 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:59:15.544 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T11:59:15.545 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T11:59:15.545 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:15.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:15.547 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:15.589 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:15.590 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:15.835 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T11:59:15.835 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T11:59:15.835 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T11:59:15.835 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T11:59:15.836 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T11:59:15.836 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:15.836 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:15.836 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:15.836 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T11:59:15.836 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:15.837 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T11:59:15.837 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:15.837 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:15.837 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899154.815329_180.1", 2020-10-05T11:59:15.837 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:15.837 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T11:59:15.837 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:15.838 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.815329Z", 2020-10-05T11:59:15.838 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:15.838 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:15.838 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:15.838 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:15.838 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T11:59:15.839 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:15.839 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:15.839 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T11:59:15.839 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:15.839 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:15.839 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:15.839 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T11:59:15.840 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:15.840 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:15.840 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:15.840 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:15.840 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T11:59:15.840 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:15.840 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:15.841 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:15.841 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:15.841 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:15.841 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:15.841 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:59:15.841 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:15.842 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:15.842 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:15.842 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T11:59:15.842 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T11:59:15.842 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T11:59:15.842 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T11:59:15.842 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T11:59:15.843 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T11:59:15.843 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T11:59:15.843 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T11:59:15.843 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T11:59:15.843 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T11:59:15.843 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:15.844 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:15.844 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T11:59:15.844 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T11:59:15.844 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T11:59:15.844 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T11:59:15.844 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T11:59:15.844 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T11:59:15.845 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T11:59:15.845 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T11:59:15.846 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T11:59:15.846 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:15.847 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T11:59:15.847 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T11:59:15.886 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:15.886 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:16.159 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T11:59:16.160 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T11:59:16.160 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T11:59:16.160 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T11:59:16.160 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T11:59:16.160 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T11:59:16.161 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:16.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:16.161 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T11:59:16.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:16.161 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T11:59:16.161 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:16.161 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:16.162 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899154.815329_180.1", 2020-10-05T11:59:16.162 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:16.162 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T11:59:16.162 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:16.162 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.815329Z", 2020-10-05T11:59:16.162 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T11:59:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T11:59:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T11:59:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T11:59:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T11:59:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T11:59:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T11:59:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T11:59:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T11:59:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T11:59:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T11:59:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T11:59:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T11:59:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T11:59:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T11:59:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T11:59:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T11:59:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T11:59:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T11:59:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T11:59:16.169 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T11:59:16.170 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T11:59:16.171 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:16.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:16.172 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:16.488+0000 7f48f91b80c0 1 bucket sync caught up with source: 2020-10-05T11:59:16.488 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000001.6.5, , , , , , , , , ] 2020-10-05T11:59:16.488 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000001.6.5, , , , , , , , , ] 2020-10-05T11:59:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:16.488+0000 7f48f91b80c0 0 bucket checkpoint complete 2020-10-05T11:59:16.519 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-13 zones={test-zone2, test-zone1} 2020-10-05T11:59:16.530 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T11:59:16.578 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:16.579 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T11:59:16.587 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:16.645 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:16.698 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:16.806 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:16.909 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-13 zones={test-zone2, test-zone1} 2020-10-05T11:59:16.910 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:16.910 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:16.910 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:16.958 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:16.958 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:17.185 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:17.183+0000 7f6a5e0740c0 1 bucket sync caught up with source: 2020-10-05T11:59:17.185 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000001.6.5, , , , , , , , , ] 2020-10-05T11:59:17.186 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000001.6.5, , , , , , , , , ] 2020-10-05T11:59:17.186 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:17.183+0000 7f6a5e0740c0 0 bucket checkpoint complete 2020-10-05T11:59:17.211 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-13 zones={test-zone3, test-zone1} 2020-10-05T11:59:17.220 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T11:59:17.266 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:17.267 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T11:59:17.273 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:17.333 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:17.391 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:17.508 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:17.614 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-13 zones={test-zone3, test-zone1} 2020-10-05T11:59:17.615 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:17.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:17.616 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:17.884+0000 7efe8a1e80c0 1 bucket sync caught up with source: 2020-10-05T11:59:17.883 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000001.6.5, , , , , , , , , ] 2020-10-05T11:59:17.883 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000001.6.5, , , , , , , , , ] 2020-10-05T11:59:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:17.884+0000 7efe8a1e80c0 0 bucket checkpoint complete 2020-10-05T11:59:18.017 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:18.017 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:18.018 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:18.066 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:18.067 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:18.294 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:18.295+0000 7f6ae98510c0 1 bucket sync caught up with source: 2020-10-05T11:59:18.294 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000001.13.5, , , , , , , , , ] 2020-10-05T11:59:18.294 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000001.13.5, , , , , , , , , ] 2020-10-05T11:59:18.295 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:18.295+0000 7f6ae98510c0 0 bucket checkpoint complete 2020-10-05T11:59:18.322 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-14 zones={test-zone1, test-zone2} 2020-10-05T11:59:18.332 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T11:59:18.379 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:18.483 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T11:59:18.496 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:18.568 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:18.635 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:18.773 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:18.892 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-14 zones={test-zone1, test-zone2} 2020-10-05T11:59:18.893 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:18.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:18.894 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:18.941 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:18.942 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:19.182 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:19.183+0000 7f1285df60c0 1 bucket sync caught up with source: 2020-10-05T11:59:19.182 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000001.13.5, , , , , , , , , ] 2020-10-05T11:59:19.183 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000001.13.5, , , , , , , , , ] 2020-10-05T11:59:19.183 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:19.183+0000 7f1285df60c0 0 bucket checkpoint complete 2020-10-05T11:59:19.214 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-14 zones={test-zone3, test-zone2} 2020-10-05T11:59:19.226 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T11:59:19.274 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:19.275 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T11:59:19.282 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:19.337 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:19.396 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:19.507 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:19.610 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-14 zones={test-zone3, test-zone2} 2020-10-05T11:59:19.611 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-15', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:19.612 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-15', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:19.613 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-15 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:19.660 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:19.661 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:19.894 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:19.895+0000 7f63a098a0c0 1 bucket sync caught up with source: 2020-10-05T11:59:19.895 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000001.7.5, , , , , , , , , ] 2020-10-05T11:59:19.895 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000001.7.5, , , , , , , , , ] 2020-10-05T11:59:19.895 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:19.895+0000 7f63a098a0c0 0 bucket checkpoint complete 2020-10-05T11:59:19.922 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-15 zones={test-zone1, test-zone3} 2020-10-05T11:59:19.932 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T11:59:19.978 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:19.979 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T11:59:19.985 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:20.040 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:20.093 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:20.198 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:20.300 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-15 zones={test-zone1, test-zone3} 2020-10-05T11:59:20.301 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-15', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:20.302 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-15', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:20.303 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-15 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:20.568 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:20.568+0000 7fd1b0da00c0 1 bucket sync caught up with source: 2020-10-05T11:59:20.569 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000001.7.5, , , , , , , , , ] 2020-10-05T11:59:20.569 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000001.7.5, , , , , , , , , ] 2020-10-05T11:59:20.569 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:20.568+0000 7fd1b0da00c0 0 bucket checkpoint complete 2020-10-05T11:59:20.594 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-15 zones={test-zone2, test-zone3} 2020-10-05T11:59:20.604 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T11:59:20.654 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:20.655 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T11:59:20.660 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2020-10-05T11:59:20.713 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:20.765 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:20.874 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2020-10-05T11:59:20.982 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-15 zones={test-zone2, test-zone3} 2020-10-05T11:59:20.995 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:20.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:20.996 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:21.043 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:21.043 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:21.272+0000 7fdd86b160c0 1 waiting for incremental sync to catch up: 2020-10-05T11:59:21.272 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000001.6.5, , , , , , , , , ] 2020-10-05T11:59:21.273 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000002.8.5, , , , , , , , , ] 2020-10-05T11:59:26.275 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:26.276+0000 7fdd86b160c0 1 waiting for incremental sync to catch up: 2020-10-05T11:59:26.276 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000001.6.5, , , , , , , , , ] 2020-10-05T11:59:26.276 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000002.8.5, , , , , , , , , ] 2020-10-05T11:59:31.280 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:31.280+0000 7fdd86b160c0 1 waiting for incremental sync to catch up: 2020-10-05T11:59:31.280 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000001.6.5, , , , , , , , , ] 2020-10-05T11:59:31.280 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000002.8.5, , , , , , , , , ] 2020-10-05T11:59:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:36.284+0000 7fdd86b160c0 1 waiting for incremental sync to catch up: 2020-10-05T11:59:36.284 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000001.6.5, , , , , , , , , ] 2020-10-05T11:59:36.284 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000002.8.5, , , , , , , , , ] 2020-10-05T11:59:41.287 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:41.288+0000 7fdd86b160c0 1 bucket sync caught up with source: 2020-10-05T11:59:41.288 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000002.8.5, , , , , , , , , ] 2020-10-05T11:59:41.288 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000002.8.5, , , , , , , , , ] 2020-10-05T11:59:41.288 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:41.288+0000 7fdd86b160c0 0 bucket checkpoint complete 2020-10-05T11:59:41.318 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-13 zones={test-zone2, test-zone1} 2020-10-05T11:59:41.329 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T11:59:41.378 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T11:59:41.441 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-13 zones={test-zone2, test-zone1} 2020-10-05T11:59:41.442 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:41.443 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:41.443 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:41.489 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:41.489 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:41.717 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:41.719+0000 7fdee34b00c0 1 bucket sync caught up with source: 2020-10-05T11:59:41.718 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000002.8.5, , , , , , , , , ] 2020-10-05T11:59:41.718 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000002.8.5, , , , , , , , , ] 2020-10-05T11:59:41.718 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:41.719+0000 7fdee34b00c0 0 bucket checkpoint complete 2020-10-05T11:59:41.744 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-13 zones={test-zone3, test-zone1} 2020-10-05T11:59:41.755 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T11:59:41.802 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T11:59:41.873 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-13 zones={test-zone3, test-zone1} 2020-10-05T11:59:41.873 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:41.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:41.874 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:42.169 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:42.172+0000 7f677024d0c0 1 bucket sync caught up with source: 2020-10-05T11:59:42.169 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000002.8.5, , , , , , , , , ] 2020-10-05T11:59:42.169 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000002.8.5, , , , , , , , , ] 2020-10-05T11:59:42.169 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T11:59:42.172+0000 7f677024d0c0 0 bucket checkpoint complete 2020-10-05T11:59:42.301 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:42.302 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T11:59:42.302 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T11:59:42.349 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T11:59:42.349 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T11:59:42.593 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:42.595+0000 7f2d2fd9b0c0 1 waiting for incremental sync to catch up: 2020-10-05T11:59:42.594 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000001.13.5, , , , , , , , , ] 2020-10-05T11:59:42.594 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000002.15.5, , , , , , , , , ] 2020-10-05T11:59:47.597 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:47.599+0000 7f2d2fd9b0c0 1 waiting for incremental sync to catch up: 2020-10-05T11:59:47.598 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000001.13.5, , , , , , , , , ] 2020-10-05T11:59:47.598 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000002.15.5, , , , , , , , , ] 2020-10-05T11:59:52.600 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:52.599+0000 7f2d2fd9b0c0 1 waiting for incremental sync to catch up: 2020-10-05T11:59:52.601 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000001.13.5, , , , , , , , , ] 2020-10-05T11:59:52.601 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000002.15.5, , , , , , , , , ] 2020-10-05T11:59:57.604 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T11:59:57.603+0000 7f2d2fd9b0c0 1 waiting for incremental sync to catch up: 2020-10-05T11:59:57.605 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000001.13.5, , , , , , , , , ] 2020-10-05T11:59:57.605 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000002.15.5, , , , , , , , , ] 2020-10-05T12:00:02.608 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:02.607+0000 7f2d2fd9b0c0 1 bucket sync caught up with source: 2020-10-05T12:00:02.608 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000002.15.5, , , , , , , , , ] 2020-10-05T12:00:02.609 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000002.15.5, , , , , , , , , ] 2020-10-05T12:00:02.609 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:02.607+0000 7f2d2fd9b0c0 0 bucket checkpoint complete 2020-10-05T12:00:02.638 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-14 zones={test-zone1, test-zone2} 2020-10-05T12:00:02.648 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:00:02.698 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:00:02.761 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-14 zones={test-zone1, test-zone2} 2020-10-05T12:00:02.761 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:02.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:02.762 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:00:02.812 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:00:02.812 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:00:03.032 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:03.031+0000 7f022f5160c0 1 bucket sync caught up with source: 2020-10-05T12:00:03.032 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000002.15.5, , , , , , , , , ] 2020-10-05T12:00:03.032 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000002.15.5, , , , , , , , , ] 2020-10-05T12:00:03.032 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:03.031+0000 7f022f5160c0 0 bucket checkpoint complete 2020-10-05T12:00:03.064 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-14 zones={test-zone3, test-zone2} 2020-10-05T12:00:03.074 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:00:03.126 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:00:03.190 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-14 zones={test-zone3, test-zone2} 2020-10-05T12:00:03.211 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-15', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:03.212 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-15', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:03.213 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-15 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:00:03.256 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:00:03.256 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:00:03.458 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:03.459+0000 7ff9d312a0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:00:03.458 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000001.7.5, , , , , , , , , ] 2020-10-05T12:00:03.459 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000002.10.5, , , , , , , , , ] 2020-10-05T12:00:08.462 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:08.463+0000 7ff9d312a0c0 1 bucket sync caught up with source: 2020-10-05T12:00:08.463 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000002.10.5, , , , , , , , , ] 2020-10-05T12:00:08.463 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000002.10.5, , , , , , , , , ] 2020-10-05T12:00:08.463 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:08.463+0000 7ff9d312a0c0 0 bucket checkpoint complete 2020-10-05T12:00:08.495 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-15 zones={test-zone1, test-zone3} 2020-10-05T12:00:08.505 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:00:08.554 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:00:08.617 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-15 zones={test-zone1, test-zone3} 2020-10-05T12:00:08.617 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-15', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:08.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-15', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:08.618 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-15 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:00:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:00:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:00:08.903 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:00:08.904+0000 7ffbcfdb50c0 1 bucket sync caught up with source: 2020-10-05T12:00:08.903 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000002.10.5, , , , , , , , , ] 2020-10-05T12:00:08.903 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000002.10.5, , , , , , , , , ] 2020-10-05T12:00:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:00:08.904+0000 7ffbcfdb50c0 0 bucket checkpoint complete 2020-10-05T12:00:08.934 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-15 zones={test-zone2, test-zone3} 2020-10-05T12:00:08.946 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:00:08.998 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:00:09.065 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-15 zones={test-zone2, test-zone3} 2020-10-05T12:00:09.067 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_object_delete ... ok 2020-10-05T12:00:09.068 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-16 2020-10-05T12:00:09.099 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-17 2020-10-05T12:00:09.155 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=dzadif-18 2020-10-05T12:00:09.266 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:00:09.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:00:09.267 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:00:09.300 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:00:09.301 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:00:09.489 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T12:00:09.520 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:00:09.521 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:00:09.521 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899209.261322_224.1", 2020-10-05T12:00:09.521 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:00:09.261322Z" 2020-10-05T12:00:09.521 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:00:09.522 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:00:09.522 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:00:09.522 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:02.535244Z" 2020-10-05T12:00:09.522 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:00:09.522 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:00:09.522 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:00:09.523 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:00:09.523 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:00:09.523 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:00:09.523 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:00:09.523 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:00:09.523 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:00:09.524 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:00:09.524 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T12:00:09.525 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:00:09.525 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:00:09.526 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:00:09.568 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:00:09.568 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:00:09.810 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:00:09.810 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:00:09.810 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:00:09.810 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:00:09.811 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:00:09.811 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:00:09.811 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:00:09.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:00:09.811 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:00:09.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:00:09.812 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:00:09.812 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:00:09.812 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:00:09.812 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899209.261322_224.1", 2020-10-05T12:00:09.812 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:00:09.812 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:00:09.813 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:00:09.813 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.261322Z", 2020-10-05T12:00:09.813 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:00:09.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:00:09.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:00:09.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:00:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:00:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:00:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:00:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:00:09.814 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:00:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:00:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:00:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:00:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:00:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:00:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:00:09.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:00:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:00:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:00:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:00:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:00:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:00:09.816 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:00:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:00:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:00:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:00:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:00:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:00:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:00:09.817 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:00:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:00:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:00:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:00:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:00:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:00:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:00:09.818 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:00:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:00:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:00:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:00:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:00:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:00:09.819 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:00:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:00:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:00:09.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:00:09.820 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:00:09.821 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T12:00:09.822 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T12:00:09.822 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:00:09.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:00:09.823 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:00:09.864 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:00:09.864 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:00:10.109 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:00:10.109 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:00:10.109 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:00:10.110 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:00:10.110 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:00:10.110 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:00:10.110 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:00:10.110 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:00:10.110 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:00:10.111 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:00:10.111 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:00:10.111 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:00:10.111 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:00:10.111 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899209.261322_224.1", 2020-10-05T12:00:10.111 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:00:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T12:00:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:00:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.261322Z", 2020-10-05T12:00:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:00:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:00:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:00:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:00:10.113 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:00:10.113 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:00:10.113 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:00:10.113 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:00:10.113 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:00:10.113 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:00:10.113 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:00:10.114 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:00:10.114 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:00:10.114 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:00:10.114 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:00:10.114 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:00:10.114 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:00:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:00:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:00:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:00:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:00:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:00:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:00:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:00:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:00:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:00:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:00:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:00:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:00:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:00:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:00:10.117 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:00:10.117 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:00:10.117 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:00:10.117 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:00:10.117 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:00:10.117 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:00:10.117 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:00:10.118 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:00:10.118 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:00:10.118 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:00:10.118 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:00:10.118 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T12:00:10.118 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T12:00:10.118 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:00:10.119 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:00:10.120 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T12:00:10.120 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T12:00:10.121 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:00:10.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:00:10.121 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:00:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:00:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:00:10.425 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:00:10.425 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:00:10.425 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:00:10.426 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:00:10.426 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:00:10.426 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:00:10.426 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:00:10.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:00:10.426 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:00:10.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:00:10.427 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:00:10.427 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:00:10.427 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:00:10.427 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899209.261322_224.1", 2020-10-05T12:00:10.427 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:00:10.428 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:00:10.428 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:00:10.428 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.261322Z", 2020-10-05T12:00:10.428 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:00:10.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:00:10.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:00:10.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:00:10.429 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:00:10.429 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:00:10.429 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:00:10.429 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:00:10.429 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:00:10.430 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:00:10.430 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:00:10.430 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:00:10.430 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:00:10.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:00:10.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:00:10.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:00:10.431 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:00:10.431 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:00:10.431 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:00:10.431 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:00:10.431 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:00:10.431 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:00:10.432 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:00:10.432 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:00:10.432 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:00:10.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:00:10.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:00:10.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:00:10.432 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:00:10.433 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:00:10.433 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:00:10.433 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:00:10.433 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:00:10.433 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:00:10.433 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:00:10.434 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:00:10.434 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:00:10.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:00:10.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:00:10.434 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:00:10.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:00:10.434 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:00:10.435 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:00:10.435 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:00:10.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:00:10.435 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:00:10.436 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T12:00:10.490 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:10.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:10.492 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:00:10.540 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:00:10.540 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:00:10.774 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:00:10.776+0000 7f572d2000c0 1 waiting for incremental sync to catch up: 2020-10-05T12:00:10.774 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , , , ] 2020-10-05T12:00:10.774 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000002.11.10, , , , , ] 2020-10-05T12:00:15.778 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:00:15.780+0000 7f572d2000c0 1 bucket sync caught up with source: 2020-10-05T12:00:15.779 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000002.11.10, , , , , ] 2020-10-05T12:00:15.779 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000002.11.10, , , , , ] 2020-10-05T12:00:15.779 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:00:15.780+0000 7f572d2000c0 0 bucket checkpoint complete 2020-10-05T12:00:15.812 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:15.813 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:15.813 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:00:15.861 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:00:15.862 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:00:16.093 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:16.095+0000 7f9a0a1b60c0 1 waiting for incremental sync to catch up: 2020-10-05T12:00:16.094 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.11.10, , , , , ] 2020-10-05T12:00:16.094 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.17.9, , , , , ] 2020-10-05T12:00:21.097 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:21.099+0000 7f9a0a1b60c0 1 waiting for incremental sync to catch up: 2020-10-05T12:00:21.098 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.11.10, , , , , ] 2020-10-05T12:00:21.098 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.17.9, , , , , ] 2020-10-05T12:00:26.100 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:26.099+0000 7f9a0a1b60c0 1 bucket sync caught up with source: 2020-10-05T12:00:26.100 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000006.17.9, , , , , ] 2020-10-05T12:00:26.101 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.17.9, , , , , ] 2020-10-05T12:00:26.101 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:26.099+0000 7f9a0a1b60c0 0 bucket checkpoint complete 2020-10-05T12:00:26.128 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:26.128 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:26.129 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:00:26.175 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:00:26.175 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:00:26.411 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:00:26.416+0000 7fe495d350c0 1 bucket sync caught up with source: 2020-10-05T12:00:26.412 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000006.17.9, , , , , ] 2020-10-05T12:00:26.412 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000006.17.9, , , , , ] 2020-10-05T12:00:26.412 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:00:26.416+0000 7fe495d350c0 0 bucket checkpoint complete 2020-10-05T12:00:26.594 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:26.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:26.596 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:00:26.642 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:00:26.642 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:00:26.874 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:26.875+0000 7fd7496430c0 1 bucket sync caught up with source: 2020-10-05T12:00:26.874 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:00:26.874 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:00:26.874 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:26.875+0000 7fd7496430c0 0 bucket checkpoint complete 2020-10-05T12:00:26.897 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:26.898 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:00:26.898 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:00:26.950 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:00:26.951 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:00:27.153 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:27.155+0000 7fcacb8a30c0 1 waiting for incremental sync to catch up: 2020-10-05T12:00:27.154 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:00:27.154 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.20.9, , , , , ] 2020-10-05T12:00:32.157 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:32.159+0000 7fcacb8a30c0 1 waiting for incremental sync to catch up: 2020-10-05T12:00:32.158 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:00:32.158 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.20.9, , , , , ] 2020-10-05T12:00:37.161 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:37.163+0000 7fcacb8a30c0 1 waiting for incremental sync to catch up: 2020-10-05T12:00:37.161 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:00:37.162 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.20.9, , , , , ] 2020-10-05T12:00:42.165 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:42.167+0000 7fcacb8a30c0 1 waiting for incremental sync to catch up: 2020-10-05T12:00:42.165 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:00:42.165 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.20.9, , , , , ] 2020-10-05T12:00:47.169 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:47.171+0000 7fcacb8a30c0 1 waiting for incremental sync to catch up: 2020-10-05T12:00:47.169 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:00:47.169 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.20.9, , , , , ] 2020-10-05T12:00:52.172 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:52.175+0000 7fcacb8a30c0 1 waiting for incremental sync to catch up: 2020-10-05T12:00:52.173 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:00:52.173 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.20.9, , , , , ] 2020-10-05T12:00:57.176 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:00:57.175+0000 7fcacb8a30c0 1 waiting for incremental sync to catch up: 2020-10-05T12:00:57.176 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:00:57.176 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.20.9, , , , , ] 2020-10-05T12:01:02.180 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:01:02.178+0000 7fcacb8a30c0 1 waiting for incremental sync to catch up: 2020-10-05T12:01:02.181 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:01:02.181 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.20.9, , , , , ] 2020-10-05T12:01:07.185 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:01:07.182+0000 7fcacb8a30c0 1 bucket sync caught up with source: 2020-10-05T12:01:07.186 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000006.20.9, , , , , ] 2020-10-05T12:01:07.186 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.20.9, , , , , ] 2020-10-05T12:01:07.186 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:01:07.182+0000 7fcacb8a30c0 0 bucket checkpoint complete 2020-10-05T12:01:07.276 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:07.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:07.277 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:01:07.332 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:01:07.333 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:01:07.541 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:01:07.538+0000 7faa6a70b0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:01:07.542 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , , , ] 2020-10-05T12:01:07.542 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000002.18.10, , , , , ] 2020-10-05T12:01:12.544 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:01:12.541+0000 7faa6a70b0c0 1 bucket sync caught up with source: 2020-10-05T12:01:12.544 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.18.10, , , , , ] 2020-10-05T12:01:12.545 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000002.18.10, , , , , ] 2020-10-05T12:01:12.545 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:01:12.541+0000 7faa6a70b0c0 0 bucket checkpoint complete 2020-10-05T12:01:12.574 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:12.575 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:12.575 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:01:12.623 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:01:12.624 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:01:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:12.851+0000 7f029f9d70c0 1 waiting for incremental sync to catch up: 2020-10-05T12:01:12.849 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000002.18.10, , , , , ] 2020-10-05T12:01:12.849 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000005.24.9, , , , , ] 2020-10-05T12:01:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:17.854+0000 7f029f9d70c0 1 waiting for incremental sync to catch up: 2020-10-05T12:01:17.854 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000002.18.10, , , , , ] 2020-10-05T12:01:17.854 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000005.24.9, , , , , ] 2020-10-05T12:01:22.857 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:22.857+0000 7f029f9d70c0 1 waiting for incremental sync to catch up: 2020-10-05T12:01:22.858 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000002.18.10, , , , , ] 2020-10-05T12:01:22.858 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000005.24.9, , , , , ] 2020-10-05T12:01:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:27.861+0000 7f029f9d70c0 1 waiting for incremental sync to catch up: 2020-10-05T12:01:27.862 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000002.18.10, , , , , ] 2020-10-05T12:01:27.862 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000005.24.9, , , , , ] 2020-10-05T12:01:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:32.864+0000 7f029f9d70c0 1 bucket sync caught up with source: 2020-10-05T12:01:32.867 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000005.24.9, , , , , ] 2020-10-05T12:01:32.867 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000005.24.9, , , , , ] 2020-10-05T12:01:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:32.864+0000 7f029f9d70c0 0 bucket checkpoint complete 2020-10-05T12:01:34.647 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:34.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:34.648 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:01:34.694 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:01:34.694 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:01:34.909 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:34.908+0000 7fa0652310c0 1 waiting for incremental sync to catch up: 2020-10-05T12:01:34.909 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000010.28.5, , 00000000003.10.9, , 00000000008.22.10, , , , , ] 2020-10-05T12:01:34.909 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000010.28.5, , 00000000003.10.9, , 00000000009.24.9, , , , , ] 2020-10-05T12:01:39.913 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:39.912+0000 7fa0652310c0 1 waiting for incremental sync to catch up: 2020-10-05T12:01:39.914 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000010.28.5, , 00000000003.10.9, , 00000000008.22.10, , , , , ] 2020-10-05T12:01:39.914 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000010.28.5, , 00000000003.10.9, , 00000000009.24.9, , , , , ] 2020-10-05T12:01:44.918 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:44.915+0000 7fa0652310c0 1 waiting for incremental sync to catch up: 2020-10-05T12:01:44.919 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000010.28.5, , 00000000003.10.9, , 00000000008.22.10, , , , , ] 2020-10-05T12:01:44.919 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000010.28.5, , 00000000003.10.9, , 00000000009.24.9, , , , , ] 2020-10-05T12:01:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:49.919+0000 7fa0652310c0 1 waiting for incremental sync to catch up: 2020-10-05T12:01:49.923 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000010.28.5, , 00000000003.10.9, , 00000000008.22.10, , , , , ] 2020-10-05T12:01:49.923 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000010.28.5, , 00000000003.10.9, , 00000000009.24.9, , , , , ] 2020-10-05T12:01:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:54.926+0000 7fa0652310c0 1 bucket sync caught up with source: 2020-10-05T12:01:54.928 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000010.28.5, , 00000000003.10.9, , 00000000009.24.9, , , , , ] 2020-10-05T12:01:54.928 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000010.28.5, , 00000000003.10.9, , 00000000009.24.9, , , , , ] 2020-10-05T12:01:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:54.926+0000 7fa0652310c0 0 bucket checkpoint complete 2020-10-05T12:01:54.958 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:54.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:54.960 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:01:55.006 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:01:55.007 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:01:55.240 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:01:55.238+0000 7fda79a180c0 1 bucket sync caught up with source: 2020-10-05T12:01:55.241 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000010.28.5, , 00000000003.10.9, , 00000000009.24.9, , , , , ] 2020-10-05T12:01:55.241 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000010.28.5, , 00000000003.10.9, , 00000000009.24.9, , , , , ] 2020-10-05T12:01:55.241 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:01:55.238+0000 7fda79a180c0 0 bucket checkpoint complete 2020-10-05T12:01:55.265 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:55.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:55.266 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:01:55.313 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:01:55.314 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:01:55.554 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:55.550+0000 7f9d349750c0 1 bucket sync caught up with source: 2020-10-05T12:01:55.554 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000010.28.5, , 00000000003.10.9, , 00000000009.24.9, , , , , ] 2020-10-05T12:01:55.554 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000010.28.5, , 00000000003.10.9, , 00000000009.24.9, , , , , ] 2020-10-05T12:01:55.555 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:55.550+0000 7f9d349750c0 0 bucket checkpoint complete 2020-10-05T12:01:55.675 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:55.676 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:55.676 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:01:55.725 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:01:55.725 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:01:55.945 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:01:55.942+0000 7fbd441000c0 1 bucket sync caught up with source: 2020-10-05T12:01:55.945 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000003.20.9, , 00000000010.27.5, , 00000000007.25.9, , , , , ] 2020-10-05T12:01:55.946 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000003.20.9, , 00000000010.27.5, , 00000000007.25.9, , , , , ] 2020-10-05T12:01:55.946 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:01:55.942+0000 7fbd441000c0 0 bucket checkpoint complete 2020-10-05T12:01:55.977 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:55.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:55.978 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:01:56.024 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:01:56.024 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:01:56.242 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:01:56.238+0000 7fd7cea990c0 1 bucket sync caught up with source: 2020-10-05T12:01:56.243 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000003.20.9, , 00000000010.27.5, , 00000000007.25.9, , , , , ] 2020-10-05T12:01:56.243 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000003.20.9, , 00000000010.27.5, , 00000000007.25.9, , , , , ] 2020-10-05T12:01:56.243 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:01:56.238+0000 7fd7cea990c0 0 bucket checkpoint complete 2020-10-05T12:01:56.274 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:56.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:56.276 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:01:56.364 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:01:56.364 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:01:56.597 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:01:56.594+0000 7f1e160520c0 1 bucket sync caught up with source: 2020-10-05T12:01:56.598 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000003.17.9, , 00000000003.12.9, , 00000000014.42.5, , , , , ] 2020-10-05T12:01:56.598 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000003.17.9, , 00000000003.12.9, , 00000000014.42.5, , , , , ] 2020-10-05T12:01:56.598 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:01:56.594+0000 7f1e160520c0 0 bucket checkpoint complete 2020-10-05T12:01:56.624 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:56.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:56.625 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:01:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:01:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:01:56.915 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:56.914+0000 7f6782fbf0c0 1 bucket sync caught up with source: 2020-10-05T12:01:56.916 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000003.17.9, , 00000000003.12.9, , 00000000014.42.5, , , , , ] 2020-10-05T12:01:56.916 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000003.17.9, , 00000000003.12.9, , 00000000014.42.5, , , , , ] 2020-10-05T12:01:56.917 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:01:56.914+0000 7f6782fbf0c0 0 bucket checkpoint complete 2020-10-05T12:01:56.945 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-16 zones={test-zone2, test-zone1} 2020-10-05T12:01:56.956 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:01:56.963 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:01:56.964 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:01:56.964 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:01:56.964 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:01:56.964 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:01:56.970 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:01:56.971 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:01:56.971 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:01:56.972 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:01:56.985 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:01:56.996 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:01:57.068 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:01:57.128 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:01:57.182 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:01:57.297 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:01:57.403 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:01:57.461 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:01:57.577 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:01:57.681 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:01:57.735 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:01:57.848 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:01:57.954 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-16 zones={test-zone2, test-zone1} 2020-10-05T12:01:57.955 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-16 zones={test-zone3, test-zone1} 2020-10-05T12:01:57.963 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:01:57.967 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:01:57.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:01:57.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:01:57.968 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:01:57.968 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:01:57.972 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:01:57.973 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:01:57.973 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:01:57.973 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:01:57.982 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:01:57.989 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:01:58.052 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:01:58.114 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:01:58.167 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:01:58.281 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:01:58.385 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:01:58.444 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:01:58.557 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:01:58.661 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:01:58.715 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:01:58.829 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:01:58.934 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-16 zones={test-zone3, test-zone1} 2020-10-05T12:01:58.935 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-16 zones={test-zone3, test-zone2} 2020-10-05T12:01:58.947 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:01:58.953 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:01:58.953 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:01:58.954 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:01:58.954 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:01:58.955 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:01:58.961 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:01:58.961 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:01:58.961 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:01:58.962 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:01:58.972 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:01:58.982 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:01:59.050 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:01:59.113 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:01:59.168 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:01:59.283 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:01:59.389 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:01:59.443 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:01:59.567 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:01:59.674 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:01:59.731 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:01:59.850 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:01:59.958 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-16 zones={test-zone3, test-zone2} 2020-10-05T12:01:59.959 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:59.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:01:59.960 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:00.002 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:00.003 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:00.219 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:00.214+0000 7fbc4b1b00c0 1 bucket sync caught up with source: 2020-10-05T12:02:00.219 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000010.25.5, , 00000000003.9.9, , 00000000007.18.9, , , , , ] 2020-10-05T12:02:00.219 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000010.25.5, , 00000000003.9.9, , 00000000007.18.9, , , , , ] 2020-10-05T12:02:00.219 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:00.214+0000 7fbc4b1b00c0 0 bucket checkpoint complete 2020-10-05T12:02:00.251 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:00.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:00.252 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:00.292 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:00.292 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:00.511 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:00.506+0000 7f06d5f3b0c0 1 bucket sync caught up with source: 2020-10-05T12:02:00.512 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000010.25.5, , 00000000003.9.9, , 00000000007.18.9, , , , , ] 2020-10-05T12:02:00.512 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000010.25.5, , 00000000003.9.9, , 00000000007.18.9, , , , , ] 2020-10-05T12:02:00.512 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:00.506+0000 7f06d5f3b0c0 0 bucket checkpoint complete 2020-10-05T12:02:00.537 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:00.537 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:00.538 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:00.822+0000 7fe1a490a0c0 1 bucket sync caught up with source: 2020-10-05T12:02:00.826 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000010.25.5, , 00000000003.9.9, , 00000000007.18.9, , , , , ] 2020-10-05T12:02:00.827 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000010.25.5, , 00000000003.9.9, , 00000000007.18.9, , , , , ] 2020-10-05T12:02:00.827 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:00.822+0000 7fe1a490a0c0 0 bucket checkpoint complete 2020-10-05T12:02:00.950 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:00.951 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:00.952 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:00.997 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:00.997 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:01.223 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:01.218+0000 7fee80b5e0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:02:01.223 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000003.17.9, , 00000000010.29.5, , 00000000008.25.10, , , , , ] 2020-10-05T12:02:01.224 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000003.17.9, , 00000000010.29.5, , 00000000009.27.9, , , , , ] 2020-10-05T12:02:06.228 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:06.222+0000 7fee80b5e0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:02:06.228 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000003.17.9, , 00000000010.29.5, , 00000000008.25.10, , , , , ] 2020-10-05T12:02:06.228 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000003.17.9, , 00000000010.29.5, , 00000000009.27.9, , , , , ] 2020-10-05T12:02:11.231 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:11.226+0000 7fee80b5e0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:02:11.232 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000003.17.9, , 00000000010.29.5, , 00000000008.25.10, , , , , ] 2020-10-05T12:02:11.232 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000003.17.9, , 00000000010.29.5, , 00000000009.27.9, , , , , ] 2020-10-05T12:02:16.236 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:16.230+0000 7fee80b5e0c0 1 bucket sync caught up with source: 2020-10-05T12:02:16.236 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000003.17.9, , 00000000010.29.5, , 00000000009.27.9, , , , , ] 2020-10-05T12:02:16.236 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000003.17.9, , 00000000010.29.5, , 00000000009.27.9, , , , , ] 2020-10-05T12:02:16.236 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:16.230+0000 7fee80b5e0c0 0 bucket checkpoint complete 2020-10-05T12:02:16.263 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:16.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:16.265 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:16.306 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:16.306 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:16.533 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:16.530+0000 7f33eda540c0 1 bucket sync caught up with source: 2020-10-05T12:02:16.533 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000003.17.9, , 00000000010.29.5, , 00000000009.27.9, , , , , ] 2020-10-05T12:02:16.533 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000003.17.9, , 00000000010.29.5, , 00000000009.27.9, , , , , ] 2020-10-05T12:02:16.533 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:16.530+0000 7f33eda540c0 0 bucket checkpoint complete 2020-10-05T12:02:16.562 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:16.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:16.563 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:16.652 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:16.653 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:16.869 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:16.866+0000 7f35b9aaa0c0 1 bucket sync caught up with source: 2020-10-05T12:02:16.869 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000003.13.9, , 00000000003.12.9, , 00000000014.35.5, , , , , ] 2020-10-05T12:02:16.869 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000003.13.9, , 00000000003.12.9, , 00000000014.35.5, , , , , ] 2020-10-05T12:02:16.870 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:16.866+0000 7f35b9aaa0c0 0 bucket checkpoint complete 2020-10-05T12:02:16.896 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:16.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:16.897 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:16.945 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:16.945 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:17.193+0000 7f2e7a7650c0 1 bucket sync caught up with source: 2020-10-05T12:02:17.200 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000003.13.9, , 00000000003.12.9, , 00000000014.35.5, , , , , ] 2020-10-05T12:02:17.200 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000003.13.9, , 00000000003.12.9, , 00000000014.35.5, , , , , ] 2020-10-05T12:02:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:17.193+0000 7f2e7a7650c0 0 bucket checkpoint complete 2020-10-05T12:02:17.229 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-17 zones={test-zone2, test-zone1} 2020-10-05T12:02:17.239 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:02:17.245 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:17.246 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:17.246 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:17.247 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:17.247 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:02:17.253 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:17.254 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:17.254 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:17.254 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:17.266 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:17.275 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:17.340 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:17.396 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:17.450 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:17.563 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:17.673 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:17.731 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:17.851 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:17.957 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:18.015 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:18.128 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:18.233 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-17 zones={test-zone2, test-zone1} 2020-10-05T12:02:18.234 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-17 zones={test-zone3, test-zone1} 2020-10-05T12:02:18.244 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:02:18.250 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:18.251 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:18.251 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:18.251 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:18.252 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:02:18.256 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:18.256 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:18.256 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:18.257 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:18.265 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:18.272 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:18.335 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:18.393 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:18.447 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:18.567 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:18.669 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:18.722 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:18.836 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:18.940 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:19.000 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:19.113 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:19.216 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-17 zones={test-zone3, test-zone1} 2020-10-05T12:02:19.217 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-17 zones={test-zone3, test-zone2} 2020-10-05T12:02:19.228 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:02:19.233 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:19.234 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:19.234 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:19.235 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:19.235 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:02:19.241 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:19.242 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:19.242 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:19.242 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:19.253 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:19.261 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:19.326 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:19.383 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:19.439 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:19.553 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:19.658 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:19.712 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:19.828 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:19.947 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:20.017 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:20.157 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:20.273 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-17 zones={test-zone3, test-zone2} 2020-10-05T12:02:20.274 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:20.274 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:20.275 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:20.547 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:20.541+0000 7f80e490e0c0 1 bucket sync caught up with source: 2020-10-05T12:02:20.548 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000010.25.5, , 00000000003.11.9, , 00000000007.22.9, , , , , ] 2020-10-05T12:02:20.548 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000010.25.5, , 00000000003.11.9, , 00000000007.22.9, , , , , ] 2020-10-05T12:02:20.548 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:20.541+0000 7f80e490e0c0 0 bucket checkpoint complete 2020-10-05T12:02:20.579 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:20.580 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:20.580 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:20.630 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:20.631 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:20.881 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:20.877+0000 7fdb4f91b0c0 1 bucket sync caught up with source: 2020-10-05T12:02:20.881 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000010.25.5, , 00000000003.11.9, , 00000000007.22.9, , , , , ] 2020-10-05T12:02:20.881 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000010.25.5, , 00000000003.11.9, , 00000000007.22.9, , , , , ] 2020-10-05T12:02:20.882 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:20.877+0000 7fdb4f91b0c0 0 bucket checkpoint complete 2020-10-05T12:02:20.909 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:20.909 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:20.910 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:20.957 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:20.958 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:21.197+0000 7ff1dd25b0c0 1 bucket sync caught up with source: 2020-10-05T12:02:21.204 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000010.25.5, , 00000000003.11.9, , 00000000007.22.9, , , , , ] 2020-10-05T12:02:21.205 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000010.25.5, , 00000000003.11.9, , 00000000007.22.9, , , , , ] 2020-10-05T12:02:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:21.197+0000 7ff1dd25b0c0 0 bucket checkpoint complete 2020-10-05T12:02:21.329 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:21.330 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:21.330 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:21.376 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:21.376 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:21.605 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:21.601+0000 7f79093cc0c0 1 bucket sync caught up with source: 2020-10-05T12:02:21.606 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000003.18.9, , 00000000010.28.5, , 00000000007.30.9, , , , , ] 2020-10-05T12:02:21.606 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000003.18.9, , 00000000010.28.5, , 00000000007.30.9, , , , , ] 2020-10-05T12:02:21.606 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:21.601+0000 7f79093cc0c0 0 bucket checkpoint complete 2020-10-05T12:02:21.639 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:21.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:21.640 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:21.725 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:21.725 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:21.953 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:21.949+0000 7f31df1080c0 1 bucket sync caught up with source: 2020-10-05T12:02:21.953 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000003.18.9, , 00000000010.28.5, , 00000000007.30.9, , , , , ] 2020-10-05T12:02:21.954 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000003.18.9, , 00000000010.28.5, , 00000000007.30.9, , , , , ] 2020-10-05T12:02:21.954 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:21.949+0000 7f31df1080c0 0 bucket checkpoint complete 2020-10-05T12:02:21.984 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:21.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:21.985 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:22.033 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:22.033 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:22.271 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:22.265+0000 7f7f6e1260c0 1 bucket sync caught up with source: 2020-10-05T12:02:22.271 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000003.17.9, , 00000000003.17.9, , 00000000016.46.5, , , , , ] 2020-10-05T12:02:22.271 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000003.17.9, , 00000000003.17.9, , 00000000016.46.5, , , , , ] 2020-10-05T12:02:22.271 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:22.265+0000 7f7f6e1260c0 0 bucket checkpoint complete 2020-10-05T12:02:22.296 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:22.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:22.297 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:22.574 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:22.569+0000 7fe5fc6ae0c0 1 bucket sync caught up with source: 2020-10-05T12:02:22.575 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000003.17.9, , 00000000003.17.9, , 00000000016.46.5, , , , , ] 2020-10-05T12:02:22.575 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000003.17.9, , 00000000003.17.9, , 00000000016.46.5, , , , , ] 2020-10-05T12:02:22.575 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:22.569+0000 7fe5fc6ae0c0 0 bucket checkpoint complete 2020-10-05T12:02:22.605 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-18 zones={test-zone2, test-zone1} 2020-10-05T12:02:22.616 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:02:22.623 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:22.623 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:22.624 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:22.624 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:22.624 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:02:22.630 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:22.630 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:22.630 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:22.631 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:22.643 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:22.652 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:22.720 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:22.782 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:22.834 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:22.947 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:23.054 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:23.107 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:23.226 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:23.329 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:23.383 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:23.497 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:23.606 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-18 zones={test-zone2, test-zone1} 2020-10-05T12:02:23.607 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-18 zones={test-zone3, test-zone1} 2020-10-05T12:02:23.616 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:02:23.621 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:23.622 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:23.622 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:23.622 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:23.623 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:02:23.627 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:23.628 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:23.628 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:23.628 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:23.638 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:23.646 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:23.708 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:23.765 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:23.818 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:23.930 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:24.033 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:24.087 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:24.198 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:24.300 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:24.356 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:24.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:24.574 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-18 zones={test-zone3, test-zone1} 2020-10-05T12:02:24.575 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-18 zones={test-zone3, test-zone2} 2020-10-05T12:02:24.585 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:02:24.590 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:24.590 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:24.591 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:24.591 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:24.591 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:02:24.598 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:24.598 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:24.598 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:24.599 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:24.610 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:24.619 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:24.685 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:24.745 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:24.798 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:24.914 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:25.018 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:25.075 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:25.191 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:25.302 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:25.355 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:25.470 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:25.573 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-18 zones={test-zone3, test-zone2} 2020-10-05T12:02:26.212 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:26.213 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:26.213 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:26.257 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:26.257 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:26.502 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:26.496+0000 7f9365fa80c0 1 bucket sync caught up with source: 2020-10-05T12:02:26.502 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000011.35.5, , 00000000003.10.9, , 00000000010.27.5, , , , , ] 2020-10-05T12:02:26.502 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000011.35.5, , 00000000003.10.9, , 00000000010.27.5, , , , , ] 2020-10-05T12:02:26.502 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:26.496+0000 7f9365fa80c0 0 bucket checkpoint complete 2020-10-05T12:02:26.534 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:26.535 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:26.536 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:26.582 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:26.583 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:26.812 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:26.805+0000 7feb598e50c0 1 bucket sync caught up with source: 2020-10-05T12:02:26.812 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000011.35.5, , 00000000003.10.9, , 00000000010.27.5, , , , , ] 2020-10-05T12:02:26.812 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000011.35.5, , 00000000003.10.9, , 00000000010.27.5, , , , , ] 2020-10-05T12:02:26.812 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:26.805+0000 7feb598e50c0 0 bucket checkpoint complete 2020-10-05T12:02:26.840 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:26.840 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:26.841 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:27.116 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:27.108+0000 7fe36d9eb0c0 1 bucket sync caught up with source: 2020-10-05T12:02:27.116 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000011.35.5, , 00000000003.10.9, , 00000000010.27.5, , , , , ] 2020-10-05T12:02:27.116 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000011.35.5, , 00000000003.10.9, , 00000000010.27.5, , , , , ] 2020-10-05T12:02:27.116 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:27.108+0000 7fe36d9eb0c0 0 bucket checkpoint complete 2020-10-05T12:02:27.151 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:27.151 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:27.152 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:27.197 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:27.197 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:27.433 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:27.429+0000 7fc14c7c80c0 1 waiting for incremental sync to catch up: 2020-10-05T12:02:27.433 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000004.23.5, , 00000000010.27.5, , 00000000008.28.5, , , , , ] 2020-10-05T12:02:27.434 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000004.23.5, , 00000000011.33.5, , 00000000008.28.5, , , , , ] 2020-10-05T12:02:32.437 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:32.433+0000 7fc14c7c80c0 1 waiting for incremental sync to catch up: 2020-10-05T12:02:32.438 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000004.23.5, , 00000000010.27.5, , 00000000008.28.5, , , , , ] 2020-10-05T12:02:32.438 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000004.23.5, , 00000000011.33.5, , 00000000008.28.5, , , , , ] 2020-10-05T12:02:37.441 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:37.437+0000 7fc14c7c80c0 1 waiting for incremental sync to catch up: 2020-10-05T12:02:37.441 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000004.23.5, , 00000000010.27.5, , 00000000008.28.5, , , , , ] 2020-10-05T12:02:37.441 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000004.23.5, , 00000000011.33.5, , 00000000008.28.5, , , , , ] 2020-10-05T12:02:42.445 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:42.441+0000 7fc14c7c80c0 1 waiting for incremental sync to catch up: 2020-10-05T12:02:42.445 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000004.23.5, , 00000000010.27.5, , 00000000008.28.5, , , , , ] 2020-10-05T12:02:42.446 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000004.23.5, , 00000000011.33.5, , 00000000008.28.5, , , , , ] 2020-10-05T12:02:47.449 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:47.445+0000 7fc14c7c80c0 1 bucket sync caught up with source: 2020-10-05T12:02:47.450 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000004.23.5, , 00000000011.33.5, , 00000000008.28.5, , , , , ] 2020-10-05T12:02:47.450 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000004.23.5, , 00000000011.33.5, , 00000000008.28.5, , , , , ] 2020-10-05T12:02:47.450 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:47.445+0000 7fc14c7c80c0 0 bucket checkpoint complete 2020-10-05T12:02:47.479 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:47.480 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:47.481 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:47.527 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:47.528 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:47.765 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:47.757+0000 7facb791e0c0 1 bucket sync caught up with source: 2020-10-05T12:02:47.765 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000004.23.5, , 00000000011.33.5, , 00000000008.28.5, , , , , ] 2020-10-05T12:02:47.765 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000004.23.5, , 00000000011.33.5, , 00000000008.28.5, , , , , ] 2020-10-05T12:02:47.765 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:47.757+0000 7facb791e0c0 0 bucket checkpoint complete 2020-10-05T12:02:47.793 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:47.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:47.794 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:47.839 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:47.840 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:48.062 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:48.057+0000 7fc7917d10c0 1 bucket sync caught up with source: 2020-10-05T12:02:48.062 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000004.20.5, , 00000000004.15.5, , 00000000015.45.5, , , , , ] 2020-10-05T12:02:48.062 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000004.20.5, , 00000000004.15.5, , 00000000015.45.5, , , , , ] 2020-10-05T12:02:48.063 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:48.057+0000 7fc7917d10c0 0 bucket checkpoint complete 2020-10-05T12:02:48.087 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:48.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-16', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:48.088 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-16 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:48.135 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:48.135 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:48.383 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:48.379+0000 7f6875a9b0c0 1 bucket sync caught up with source: 2020-10-05T12:02:48.383 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000004.20.5, , 00000000004.15.5, , 00000000015.45.5, , , , , ] 2020-10-05T12:02:48.383 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000004.20.5, , 00000000004.15.5, , 00000000015.45.5, , , , , ] 2020-10-05T12:02:48.384 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:48.379+0000 7f6875a9b0c0 0 bucket checkpoint complete 2020-10-05T12:02:48.412 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-16 zones={test-zone2, test-zone1} 2020-10-05T12:02:48.423 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:02:48.430 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:48.430 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:48.431 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:48.431 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:48.431 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:02:48.438 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:48.438 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:48.439 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:48.439 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:48.450 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:48.459 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:48.528 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:48.589 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:48.644 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:48.759 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:48.865 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:48.923 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:49.040 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:49.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:49.199 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:49.313 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:49.417 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-16 zones={test-zone2, test-zone1} 2020-10-05T12:02:49.418 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-16 zones={test-zone3, test-zone1} 2020-10-05T12:02:49.426 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:02:49.431 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:49.432 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:49.432 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:49.432 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:49.433 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:02:49.437 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:49.437 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:49.437 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:49.438 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:49.447 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:49.454 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:49.518 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:49.578 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:49.631 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:49.746 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:49.848 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:49.903 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:50.019 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:50.128 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:50.183 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:50.294 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:50.401 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-16 zones={test-zone3, test-zone1} 2020-10-05T12:02:50.402 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-16 zones={test-zone3, test-zone2} 2020-10-05T12:02:50.413 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:02:50.418 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:50.418 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:50.418 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:50.419 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:50.419 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:02:50.425 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:50.426 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:50.427 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:50.427 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:50.439 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:50.448 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:50.517 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:50.576 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:50.631 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:50.745 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:50.849 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:50.902 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:51.014 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:51.119 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:51.179 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:51.293 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:51.401 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-16 zones={test-zone3, test-zone2} 2020-10-05T12:02:51.402 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:51.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:51.403 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:51.663 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:51.659+0000 7f75b9b2f0c0 1 bucket sync caught up with source: 2020-10-05T12:02:51.664 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000011.31.5, , 00000000004.12.5, , 00000000008.21.5, , , , , ] 2020-10-05T12:02:51.664 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000011.31.5, , 00000000004.12.5, , 00000000008.21.5, , , , , ] 2020-10-05T12:02:51.664 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:51.659+0000 7f75b9b2f0c0 0 bucket checkpoint complete 2020-10-05T12:02:51.696 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:51.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:51.698 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:51.744 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:51.744 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:51.959 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:51.953+0000 7ff96f2dc0c0 1 bucket sync caught up with source: 2020-10-05T12:02:51.960 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000011.31.5, , 00000000004.12.5, , 00000000008.21.5, , , , , ] 2020-10-05T12:02:51.960 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000011.31.5, , 00000000004.12.5, , 00000000008.21.5, , , , , ] 2020-10-05T12:02:51.960 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:51.953+0000 7ff96f2dc0c0 0 bucket checkpoint complete 2020-10-05T12:02:51.991 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:51.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:51.992 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:52.038 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:52.038 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:52.273 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:52.267+0000 7f81be5610c0 1 bucket sync caught up with source: 2020-10-05T12:02:52.273 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000011.31.5, , 00000000004.12.5, , 00000000008.21.5, , , , , ] 2020-10-05T12:02:52.273 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000011.31.5, , 00000000004.12.5, , 00000000008.21.5, , , , , ] 2020-10-05T12:02:52.273 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:52.267+0000 7f81be5610c0 0 bucket checkpoint complete 2020-10-05T12:02:52.305 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:52.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:52.306 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:52.347 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:52.348 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:52.564 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:52.557+0000 7f703200d0c0 1 bucket sync caught up with source: 2020-10-05T12:02:52.564 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000004.20.5, , 00000000011.36.5, , 00000000010.30.5, , , , , ] 2020-10-05T12:02:52.565 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000004.20.5, , 00000000011.36.5, , 00000000010.30.5, , , , , ] 2020-10-05T12:02:52.565 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:52.557+0000 7f703200d0c0 0 bucket checkpoint complete 2020-10-05T12:02:52.595 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:52.596 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:52.597 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:52.682 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:52.683 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:52.912 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:52.905+0000 7f78c43d20c0 1 bucket sync caught up with source: 2020-10-05T12:02:52.913 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000004.20.5, , 00000000011.36.5, , 00000000010.30.5, , , , , ] 2020-10-05T12:02:52.913 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000004.20.5, , 00000000011.36.5, , 00000000010.30.5, , , , , ] 2020-10-05T12:02:52.913 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:52.905+0000 7f78c43d20c0 0 bucket checkpoint complete 2020-10-05T12:02:52.943 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:52.944 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:52.944 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:52.991 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:52.992 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:53.209 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:53.205+0000 7f3b7181d0c0 1 bucket sync caught up with source: 2020-10-05T12:02:53.209 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000004.16.5, , 00000000004.15.5, , 00000000015.38.5, , , , , ] 2020-10-05T12:02:53.209 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000004.16.5, , 00000000004.15.5, , 00000000015.38.5, , , , , ] 2020-10-05T12:02:53.210 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:53.205+0000 7f3b7181d0c0 0 bucket checkpoint complete 2020-10-05T12:02:53.242 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:53.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-17', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:53.244 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-17 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:53.293 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:53.293 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:53.530 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:53.527+0000 7fa4666ca0c0 1 bucket sync caught up with source: 2020-10-05T12:02:53.530 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000004.16.5, , 00000000004.15.5, , 00000000015.38.5, , , , , ] 2020-10-05T12:02:53.530 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000004.16.5, , 00000000004.15.5, , 00000000015.38.5, , , , , ] 2020-10-05T12:02:53.530 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:53.527+0000 7fa4666ca0c0 0 bucket checkpoint complete 2020-10-05T12:02:53.562 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-17 zones={test-zone2, test-zone1} 2020-10-05T12:02:53.573 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:02:53.580 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:53.580 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:53.581 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:53.581 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:53.581 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:02:53.588 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:53.588 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:53.589 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:53.589 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:53.601 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:53.612 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:53.680 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:53.745 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:53.799 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:53.922 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:54.025 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:54.079 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:54.198 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:54.302 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:54.359 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:54.473 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:54.578 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-17 zones={test-zone2, test-zone1} 2020-10-05T12:02:54.579 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-17 zones={test-zone3, test-zone1} 2020-10-05T12:02:54.588 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:02:54.593 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:54.594 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:54.594 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:54.594 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:54.595 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:02:54.600 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:54.601 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:54.601 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:54.601 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:54.612 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:54.621 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:54.688 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:54.747 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:54.807 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:54.922 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:55.034 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:55.087 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:55.200 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:55.304 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:55.361 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:55.477 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:55.581 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-17 zones={test-zone3, test-zone1} 2020-10-05T12:02:55.582 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-17 zones={test-zone3, test-zone2} 2020-10-05T12:02:55.592 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:02:55.596 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:55.597 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:55.597 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:55.597 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:55.598 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:02:55.603 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:55.604 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:55.604 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:55.604 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:55.613 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:55.622 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:55.687 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:55.749 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:55.804 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:55.922 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:56.026 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:56.084 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:56.203 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:56.314 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:56.371 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:56.489 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:56.596 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-17 zones={test-zone3, test-zone2} 2020-10-05T12:02:56.597 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:56.598 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:56.598 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:56.870 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:56.867+0000 7f04668900c0 1 bucket sync caught up with source: 2020-10-05T12:02:56.870 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000011.32.5, , 00000000004.14.5, , 00000000008.25.5, , , , , ] 2020-10-05T12:02:56.870 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000011.32.5, , 00000000004.14.5, , 00000000008.25.5, , , , , ] 2020-10-05T12:02:56.871 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:56.867+0000 7f04668900c0 0 bucket checkpoint complete 2020-10-05T12:02:56.900 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:56.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:56.901 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:56.949 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:56.950 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:57.172 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:57.165+0000 7f8ca1b630c0 1 bucket sync caught up with source: 2020-10-05T12:02:57.173 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000011.32.5, , 00000000004.14.5, , 00000000008.25.5, , , , , ] 2020-10-05T12:02:57.173 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000011.32.5, , 00000000004.14.5, , 00000000008.25.5, , , , , ] 2020-10-05T12:02:57.173 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:57.165+0000 7f8ca1b630c0 0 bucket checkpoint complete 2020-10-05T12:02:57.199 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:57.200 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:57.200 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:57.245 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:57.246 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:57.488 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:57.483+0000 7f8ec6b2d0c0 1 bucket sync caught up with source: 2020-10-05T12:02:57.489 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000011.32.5, , 00000000004.14.5, , 00000000008.25.5, , , , , ] 2020-10-05T12:02:57.489 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000011.32.5, , 00000000004.14.5, , 00000000008.25.5, , , , , ] 2020-10-05T12:02:57.489 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:57.483+0000 7f8ec6b2d0c0 0 bucket checkpoint complete 2020-10-05T12:02:57.610 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:57.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:57.611 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:57.661 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:57.661 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:57.887 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:57.881+0000 7f98784760c0 1 bucket sync caught up with source: 2020-10-05T12:02:57.887 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000004.21.5, , 00000000011.34.5, , 00000000008.33.5, , , , , ] 2020-10-05T12:02:57.888 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000004.21.5, , 00000000011.34.5, , 00000000008.33.5, , , , , ] 2020-10-05T12:02:57.888 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:57.881+0000 7f98784760c0 0 bucket checkpoint complete 2020-10-05T12:02:57.919 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:57.920 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:57.920 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:57.965 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:57.966 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:58.206 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:58.201+0000 7f884b9f40c0 1 bucket sync caught up with source: 2020-10-05T12:02:58.206 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000004.21.5, , 00000000011.34.5, , 00000000008.33.5, , , , , ] 2020-10-05T12:02:58.207 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000004.21.5, , 00000000011.34.5, , 00000000008.33.5, , , , , ] 2020-10-05T12:02:58.207 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:58.201+0000 7f884b9f40c0 0 bucket checkpoint complete 2020-10-05T12:02:58.238 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:58.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:58.239 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:58.329 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:58.329 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:58.561 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:58.557+0000 7fd64fe740c0 1 bucket sync caught up with source: 2020-10-05T12:02:58.562 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, 00000000004.20.5, , 00000000004.20.5, , 00000000017.49.5, , , , , ] 2020-10-05T12:02:58.562 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, 00000000004.20.5, , 00000000004.20.5, , 00000000017.49.5, , , , , ] 2020-10-05T12:02:58.562 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:02:58.557+0000 7fd64fe740c0 0 bucket checkpoint complete 2020-10-05T12:02:58.590 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:58.591 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-18', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:02:58.591 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-18 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:02:58.638 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:02:58.638 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:02:58.853 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:58.847+0000 7fde7b50c0c0 1 bucket sync caught up with source: 2020-10-05T12:02:58.854 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, 00000000004.20.5, , 00000000004.20.5, , 00000000017.49.5, , , , , ] 2020-10-05T12:02:58.854 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, 00000000004.20.5, , 00000000004.20.5, , 00000000017.49.5, , , , , ] 2020-10-05T12:02:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:02:58.847+0000 7fde7b50c0c0 0 bucket checkpoint complete 2020-10-05T12:02:58.883 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-18 zones={test-zone2, test-zone1} 2020-10-05T12:02:58.894 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:02:58.900 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:58.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:58.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:58.902 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:58.902 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:02:58.909 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:58.909 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:58.910 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:58.910 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:58.923 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:58.933 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:59.005 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:59.064 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:59.119 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:59.236 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:02:59.345 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:59.400 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:59.517 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:02:59.623 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:59.680 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:59.800 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:02:59.907 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-18 zones={test-zone2, test-zone1} 2020-10-05T12:02:59.907 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-18 zones={test-zone3, test-zone1} 2020-10-05T12:02:59.916 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:02:59.921 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:59.922 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:59.922 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:59.922 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:59.923 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:02:59.927 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:02:59.928 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:02:59.928 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:02:59.928 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:02:59.937 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:02:59.945 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:03:00.007 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:03:00.064 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:03:00.119 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:03:00.236 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:03:00.341 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:03:00.394 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:03:00.506 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:03:00.609 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:03:00.664 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:03:00.777 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:03:00.882 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-18 zones={test-zone3, test-zone1} 2020-10-05T12:03:00.882 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-18 zones={test-zone3, test-zone2} 2020-10-05T12:03:00.894 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:03:00.899 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:03:00.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:03:00.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:03:00.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:03:00.901 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:03:00.907 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:03:00.907 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2020-10-05T12:03:00.907 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2020-10-05T12:03:00.908 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone3 2020-10-05T12:03:00.921 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:03:00.930 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:03:01.000 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:03:01.061 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:03:01.116 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:03:01.231 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2020-10-05T12:03:01.340 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:03:01.406 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:03:01.533 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2020-10-05T12:03:01.650 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:03:01.717 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:03:01.842 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone3 2020-10-05T12:03:01.956 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-18 zones={test-zone3, test-zone2} 2020-10-05T12:03:01.958 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_versioned_object_incremental_sync ... ok 2020-10-05T12:03:02.004 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:03:02.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:03:02.006 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:03:02.046 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:03:02.046 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:03:02.244 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T12:03:02.273 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:03:02.273 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:03:02.274 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899382.001389_245.1", 2020-10-05T12:03:02.274 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:03:02.001389Z" 2020-10-05T12:03:02.274 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:03:02.274 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:03:02.274 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:03:02.274 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:02.535244Z" 2020-10-05T12:03:02.275 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:03:02.275 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:03:02.275 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:03:02.275 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:03:02.275 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:03:02.275 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:03:02.275 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:03:02.276 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:03:02.276 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:03:02.276 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:03:02.277 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T12:03:02.277 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:03:02.278 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:03:02.278 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:03:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:03:02.319 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:03:02.581 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:03:02.581 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:03:02.581 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:03:02.581 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:03:02.582 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:03:02.582 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:03:02.582 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:03:02.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:03:02.583 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:03:02.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:03:02.584 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:03:02.584 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:03:02.584 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:03:02.584 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899382.001389_245.1", 2020-10-05T12:03:02.585 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:03:02.585 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:03:02.585 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:03:02.586 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:02.001389Z", 2020-10-05T12:03:02.586 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:03:02.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:03:02.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:03:02.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:03:02.587 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:03:02.587 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:03:02.588 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:03:02.588 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:03:02.588 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:03:02.589 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:03:02.589 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:03:02.589 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:03:02.590 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:03:02.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:03:02.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:03:02.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:03:02.591 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:03:02.591 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:03:02.591 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:03:02.592 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:03:02.592 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:03:02.592 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:03:02.592 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:03:02.593 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:03:02.593 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:03:02.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:03:02.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:03:02.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:03:02.594 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:03:02.594 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:03:02.595 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:03:02.595 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:03:02.595 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:03:02.596 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:03:02.596 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:03:02.596 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:03:02.596 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:03:02.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:03:02.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:03:02.597 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:03:02.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:03:02.598 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:03:02.598 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:03:02.598 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:03:02.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:03:02.599 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:03:02.600 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T12:03:02.601 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T12:03:02.602 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:03:02.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:03:02.604 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:03:02.645 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:03:02.646 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:03:02.895 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:03:02.895 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:03:02.895 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:03:02.895 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:03:02.896 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:03:02.896 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:03:02.896 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:03:02.896 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:03:02.896 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:03:02.896 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:03:02.897 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:03:02.897 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:03:02.897 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:03:02.897 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899382.001389_245.1", 2020-10-05T12:03:02.897 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:03:02.897 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T12:03:02.898 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:03:02.898 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:02.001389Z", 2020-10-05T12:03:02.898 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:03:02.898 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:03:02.898 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:03:02.898 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:03:02.899 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:03:02.899 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:03:02.899 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:03:02.899 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:03:02.899 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:03:02.899 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:03:02.899 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:03:02.900 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:03:02.900 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:03:02.900 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:03:02.900 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:03:02.900 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:03:02.900 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:03:02.900 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:03:02.901 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:03:02.901 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:03:02.901 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:03:02.901 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:03:02.901 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:03:02.901 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:03:02.901 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:03:02.901 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:03:02.902 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:03:02.902 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:03:02.902 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:03:02.902 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:03:02.902 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:03:02.902 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:03:02.902 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:03:02.903 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:03:02.903 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:03:02.903 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:03:02.903 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:03:02.903 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:03:02.903 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:03:02.903 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:03:02.904 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:03:02.904 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:03:02.904 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T12:03:02.904 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T12:03:02.904 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:03:02.904 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:03:02.905 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T12:03:02.906 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T12:03:02.906 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:03:02.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:03:02.907 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:03:02.947 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:03:02.947 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:03:03.315 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:03:03.316 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:03:03.316 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:03:03.316 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:03:03.316 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:03:03.316 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:03:03.316 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:03:03.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:03:03.317 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:03:03.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:03:03.317 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:03:03.317 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:03:03.317 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:03:03.317 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899382.001389_245.1", 2020-10-05T12:03:03.317 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:03:03.318 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:03:03.318 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:03:03.318 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:02.001389Z", 2020-10-05T12:03:03.318 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:03:03.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:03:03.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:03:03.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:03:03.319 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:03:03.319 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:03:03.319 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:03:03.319 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:03:03.319 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:03:03.319 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:03:03.319 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:03:03.320 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:03:03.320 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:03:03.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:03:03.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:03:03.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:03:03.320 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:03:03.320 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:03:03.321 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:03:03.321 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:03:03.321 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:03:03.321 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:03:03.321 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:03:03.321 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:03:03.321 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:03:03.322 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:03:03.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:03:03.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:03:03.322 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:03:03.322 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:03:03.322 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:03:03.322 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:03:03.323 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:03:03.323 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:03:03.323 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:03:03.323 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:03:03.323 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:03:03.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:03:03.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:03:03.323 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:03:03.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:03:03.324 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:03:03.324 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:03:03.324 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:03:03.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:03:03.324 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:03:03.325 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T12:03:03.374 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:03.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:03.376 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-19 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:03:03.422 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:03:03.423 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:03:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:03:03.623+0000 7f15e66440c0 1 waiting for incremental sync to catch up: 2020-10-05T12:03:03.627 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , , , ] 2020-10-05T12:03:03.627 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:03:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:03:08.626+0000 7f15e66440c0 1 bucket sync caught up with source: 2020-10-05T12:03:08.632 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:03:08.632 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:03:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:03:08.626+0000 7f15e66440c0 0 bucket checkpoint complete 2020-10-05T12:03:08.662 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:08.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:08.663 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-19 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:03:08.709 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:03:08.710 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:03:08.934 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:08.929+0000 7fc4f51650c0 1 waiting for incremental sync to catch up: 2020-10-05T12:03:08.934 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:03:08.934 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.21.9, , , , , ] 2020-10-05T12:03:13.938 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:13.933+0000 7fc4f51650c0 1 waiting for incremental sync to catch up: 2020-10-05T12:03:13.939 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:03:13.939 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.21.9, , , , , ] 2020-10-05T12:03:18.942 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:18.937+0000 7fc4f51650c0 1 waiting for incremental sync to catch up: 2020-10-05T12:03:18.943 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000002.13.10, , , , , ] 2020-10-05T12:03:18.943 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.21.9, , , , , ] 2020-10-05T12:03:23.946 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:23.940+0000 7fc4f51650c0 1 bucket sync caught up with source: 2020-10-05T12:03:23.947 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000006.21.9, , , , , ] 2020-10-05T12:03:23.947 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.21.9, , , , , ] 2020-10-05T12:03:23.947 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:23.940+0000 7fc4f51650c0 0 bucket checkpoint complete 2020-10-05T12:03:23.985 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:23.985 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:23.986 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-19 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:03:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:03:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:03:24.256 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:03:24.250+0000 7f7938f0f0c0 1 bucket sync caught up with source: 2020-10-05T12:03:24.257 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000006.21.9, , , , , ] 2020-10-05T12:03:24.257 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000006.21.9, , , , , ] 2020-10-05T12:03:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:03:24.250+0000 7f7938f0f0c0 0 bucket checkpoint complete 2020-10-05T12:03:24.293 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:24.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:24.294 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-19 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:03:24.336 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:03:24.336 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:03:24.571 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:24.564+0000 7f081b9610c0 1 bucket sync caught up with source: 2020-10-05T12:03:24.571 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000004.23.9, , , , , ] 2020-10-05T12:03:24.571 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.23.9, , , , , ] 2020-10-05T12:03:24.571 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:24.564+0000 7f081b9610c0 0 bucket checkpoint complete 2020-10-05T12:03:24.600 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:24.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:24.601 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-19 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:03:24.691 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:03:24.692 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:03:24.917 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:24.912+0000 7f5cec5380c0 1 bucket sync caught up with source: 2020-10-05T12:03:24.917 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000004.23.9, , , , , ] 2020-10-05T12:03:24.917 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.23.9, , , , , ] 2020-10-05T12:03:24.917 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:24.912+0000 7f5cec5380c0 0 bucket checkpoint complete 2020-10-05T12:03:24.948 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:24.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:24.949 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-19 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:03:24.994 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:03:24.995 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:03:25.227 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:25.224+0000 7f45a80f30c0 1 waiting for incremental sync to catch up: 2020-10-05T12:03:25.228 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000003.17.9, , , , , ] 2020-10-05T12:03:25.228 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.19.9, , , , , ] 2020-10-05T12:03:30.231 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:30.228+0000 7f45a80f30c0 1 waiting for incremental sync to catch up: 2020-10-05T12:03:30.232 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000003.17.9, , , , , ] 2020-10-05T12:03:30.232 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.19.9, , , , , ] 2020-10-05T12:03:35.235 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:35.232+0000 7f45a80f30c0 1 waiting for incremental sync to catch up: 2020-10-05T12:03:35.236 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000003.17.9, , , , , ] 2020-10-05T12:03:35.236 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.19.9, , , , , ] 2020-10-05T12:03:40.239 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:40.236+0000 7f45a80f30c0 1 waiting for incremental sync to catch up: 2020-10-05T12:03:40.239 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000003.17.9, , , , , ] 2020-10-05T12:03:40.239 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.19.9, , , , , ] 2020-10-05T12:03:45.243 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:45.240+0000 7f45a80f30c0 1 bucket sync caught up with source: 2020-10-05T12:03:45.243 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000004.19.9, , , , , ] 2020-10-05T12:03:45.243 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.19.9, , , , , ] 2020-10-05T12:03:45.243 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:03:45.240+0000 7f45a80f30c0 0 bucket checkpoint complete 2020-10-05T12:03:45.280 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:45.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:45.282 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-19 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:03:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:03:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:03:45.569 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:03:45.562+0000 7f927f08e0c0 1 bucket sync caught up with source: 2020-10-05T12:03:45.569 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000004.19.9, , , , , ] 2020-10-05T12:03:45.569 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000004.19.9, , , , , ] 2020-10-05T12:03:45.569 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:03:45.562+0000 7f927f08e0c0 0 bucket checkpoint complete 2020-10-05T12:03:45.604 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-19 zones={test-zone2, test-zone1} 2020-10-05T12:03:45.616 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:03:45.662 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:03:45.663 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:03:45.670 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:03:45.725 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:03:45.741 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:03:45.808 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:03:45.869 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-19 zones={test-zone2, test-zone1} 2020-10-05T12:03:45.870 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-19 zones={test-zone3, test-zone1} 2020-10-05T12:03:45.880 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:03:45.926 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:03:45.927 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:03:45.934 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:03:45.988 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:03:45.998 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:03:46.068 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:03:46.129 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-19 zones={test-zone3, test-zone1} 2020-10-05T12:03:46.129 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-19 zones={test-zone3, test-zone2} 2020-10-05T12:03:46.141 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:03:46.190 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:03:46.191 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:03:46.199 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:03:46.255 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:03:46.267 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:03:46.336 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:03:46.401 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-19 zones={test-zone3, test-zone2} 2020-10-05T12:03:47.914 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:47.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:03:47.916 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-19 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:03:47.962 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:03:47.962 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:03:48.192 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:03:48.186+0000 7fb0f53af0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:03:48.192 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000006.21.9, , , 00000000009.27.11, , ] 2020-10-05T12:03:48.193 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000006.21.9, , , 00000000031.85.11, , ] 2020-10-05T12:03:53.196 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:03:53.190+0000 7fb0f53af0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:03:53.197 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000006.21.9, , , 00000000009.27.11, , ] 2020-10-05T12:03:53.197 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000006.21.9, , , 00000000031.85.11, , ] 2020-10-05T12:03:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:03:58.193+0000 7fb0f53af0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:03:58.200 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000006.21.9, , , 00000000009.27.11, , ] 2020-10-05T12:03:58.200 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000006.21.9, , , 00000000031.85.11, , ] 2020-10-05T12:04:03.204 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:04:03.197+0000 7fb0f53af0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:04:03.204 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000006.21.9, , , 00000000009.27.11, , ] 2020-10-05T12:04:03.205 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000006.21.9, , , 00000000031.85.11, , ] 2020-10-05T12:04:08.207 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:04:08.201+0000 7fb0f53af0c0 1 bucket sync caught up with source: 2020-10-05T12:04:08.208 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000006.21.9, , , 00000000039.109.5, , ] 2020-10-05T12:04:08.208 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000006.21.9, , , 00000000031.85.11, , ] 2020-10-05T12:04:08.208 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:04:08.201+0000 7fb0f53af0c0 0 bucket checkpoint complete 2020-10-05T12:04:08.236 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:04:08.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:04:08.237 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-19 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:04:08.287 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:04:08.287 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:04:08.531 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:04:08.528+0000 7f17b223b0c0 1 bucket sync caught up with source: 2020-10-05T12:04:08.531 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000006.21.9, , , 00000000044.121.9, , ] 2020-10-05T12:04:08.531 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000006.21.9, , , 00000000044.121.9, , ] 2020-10-05T12:04:08.531 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:04:08.528+0000 7f17b223b0c0 0 bucket checkpoint complete 2020-10-05T12:04:08.558 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:04:08.558 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:04:08.559 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-19 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:04:08.604 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:04:08.605 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:04:08.828 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:04:08.821+0000 7fa56b2660c0 1 waiting for incremental sync to catch up: 2020-10-05T12:04:08.829 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000006.21.9, , , 00000000033.91.5, , ] 2020-10-05T12:04:08.829 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000006.21.9, , , 00000000044.121.9, , ] 2020-10-05T12:04:13.832 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:04:13.825+0000 7fa56b2660c0 1 waiting for incremental sync to catch up: 2020-10-05T12:04:13.832 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000006.21.9, , , 00000000033.91.5, , ] 2020-10-05T12:04:13.832 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000006.21.9, , , 00000000044.121.9, , ] 2020-10-05T12:04:18.835 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:04:18.829+0000 7fa56b2660c0 1 waiting for incremental sync to catch up: 2020-10-05T12:04:18.836 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000006.21.9, , , 00000000033.91.5, , ] 2020-10-05T12:04:18.836 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000006.21.9, , , 00000000044.121.9, , ] 2020-10-05T12:04:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:04:23.833+0000 7fa56b2660c0 1 waiting for incremental sync to catch up: 2020-10-05T12:04:23.840 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000006.21.9, , , 00000000033.91.5, , ] 2020-10-05T12:04:23.840 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000006.21.9, , , 00000000044.121.9, , ] 2020-10-05T12:04:28.843 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:04:28.837+0000 7fa56b2660c0 1 bucket sync caught up with source: 2020-10-05T12:04:28.844 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000006.21.9, , , 00000000044.121.9, , ] 2020-10-05T12:04:28.844 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000006.21.9, , , 00000000044.121.9, , ] 2020-10-05T12:04:28.844 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:04:28.837+0000 7fa56b2660c0 0 bucket checkpoint complete 2020-10-05T12:04:28.891 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:04:28.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:04:28.893 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-19 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:04:28.942 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:04:28.942 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:04:29.171 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:04:29.167+0000 7f80eb6960c0 1 waiting for incremental sync to catch up: 2020-10-05T12:04:29.172 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000004.23.9, , , 00000000048.135.9, , ] 2020-10-05T12:04:29.172 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.23.9, , , 00000000049.137.9, , ] 2020-10-05T12:04:34.175 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:04:34.171+0000 7f80eb6960c0 1 waiting for incremental sync to catch up: 2020-10-05T12:04:34.176 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000004.23.9, , , 00000000048.135.9, , ] 2020-10-05T12:04:34.176 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.23.9, , , 00000000049.137.9, , ] 2020-10-05T12:04:39.180 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:04:39.175+0000 7f80eb6960c0 1 waiting for incremental sync to catch up: 2020-10-05T12:04:39.180 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000004.23.9, , , 00000000048.135.9, , ] 2020-10-05T12:04:39.180 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.23.9, , , 00000000049.137.9, , ] 2020-10-05T12:04:44.184 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:04:44.179+0000 7f80eb6960c0 1 waiting for incremental sync to catch up: 2020-10-05T12:04:44.184 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000004.23.9, , , 00000000048.135.9, , ] 2020-10-05T12:04:44.184 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.23.9, , , 00000000049.137.9, , ] 2020-10-05T12:04:49.187 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:04:49.183+0000 7f80eb6960c0 1 waiting for incremental sync to catch up: 2020-10-05T12:04:49.188 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000004.23.9, , , 00000000048.135.9, , ] 2020-10-05T12:04:49.188 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.23.9, , , 00000000049.137.9, , ] 2020-10-05T12:04:54.191 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:04:54.187+0000 7f80eb6960c0 1 waiting for incremental sync to catch up: 2020-10-05T12:04:54.191 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000004.23.9, , , 00000000048.135.9, , ] 2020-10-05T12:04:54.192 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.23.9, , , 00000000049.137.9, , ] 2020-10-05T12:04:59.195 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:04:59.191+0000 7f80eb6960c0 1 waiting for incremental sync to catch up: 2020-10-05T12:04:59.195 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000004.23.9, , , 00000000048.135.9, , ] 2020-10-05T12:04:59.195 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.23.9, , , 00000000049.137.9, , ] 2020-10-05T12:05:04.198 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:04.195+0000 7f80eb6960c0 1 waiting for incremental sync to catch up: 2020-10-05T12:05:04.199 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000004.23.9, , , 00000000048.135.9, , ] 2020-10-05T12:05:04.199 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.23.9, , , 00000000049.137.9, , ] 2020-10-05T12:05:09.203 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:09.199+0000 7f80eb6960c0 1 bucket sync caught up with source: 2020-10-05T12:05:09.203 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000004.23.9, , , 00000000049.137.9, , ] 2020-10-05T12:05:09.203 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.23.9, , , 00000000049.137.9, , ] 2020-10-05T12:05:09.204 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:09.199+0000 7f80eb6960c0 0 bucket checkpoint complete 2020-10-05T12:05:09.232 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:09.232 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:09.233 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-19 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:05:09.281 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:09.281 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:09.516 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:09.511+0000 7f0813a170c0 1 bucket sync caught up with source: 2020-10-05T12:05:09.516 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000004.23.9, , , 00000000049.137.9, , ] 2020-10-05T12:05:09.516 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.23.9, , , 00000000049.137.9, , ] 2020-10-05T12:05:09.516 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:09.511+0000 7f0813a170c0 0 bucket checkpoint complete 2020-10-05T12:05:09.545 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:09.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:09.546 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-19 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:05:09.592 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:09.593 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:09.835 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:09.831+0000 7fe7e247c0c0 1 bucket sync caught up with source: 2020-10-05T12:05:09.835 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , 00000000004.19.9, , , 00000000055.140.9, , ] 2020-10-05T12:05:09.835 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , 00000000004.19.9, , , 00000000055.140.9, , ] 2020-10-05T12:05:09.835 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:09.831+0000 7fe7e247c0c0 0 bucket checkpoint complete 2020-10-05T12:05:09.862 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:09.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-19', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:09.864 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-19 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:05:09.913 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:09.913 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:10.148 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:05:10.140+0000 7f4f7772b0c0 1 bucket sync caught up with source: 2020-10-05T12:05:10.148 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , 00000000004.19.9, , , 00000000055.140.9, , ] 2020-10-05T12:05:10.148 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , 00000000004.19.9, , , 00000000055.140.9, , ] 2020-10-05T12:05:10.148 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:05:10.140+0000 7f4f7772b0c0 0 bucket checkpoint complete 2020-10-05T12:05:10.179 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-19 zones={test-zone2, test-zone1} 2020-10-05T12:05:10.194 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:05:10.204 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:05:10.205 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.205 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.206 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.206 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.206 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.207 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.207 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.207 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.207 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.208 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.208 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.208 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.209 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.209 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.209 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.210 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.210 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.210 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.211 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.211 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.211 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.212 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.212 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.212 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.213 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.213 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.213 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.214 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.214 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.214 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.215 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:05:10.227 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:05:10.227 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.228 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.228 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.228 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.229 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.229 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.229 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.230 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.230 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.230 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.230 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.231 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.231 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.231 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.232 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.232 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.232 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.233 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.233 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.233 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.233 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.234 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.234 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.234 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.235 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.235 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.235 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.236 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.236 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.236 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:10.256 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:05:10.265 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:05:10.328 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:05:10.390 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:10.444 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:10.561 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:10.669 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:10.723 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:10.843 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:10.951 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:11.007 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:11.165 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:11.270 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:11.323 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:11.445 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:11.550 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:11.608 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:11.726 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:11.831 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:11.888 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:12.022 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:12.127 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:12.183 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:12.296 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:12.402 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:12.455 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:12.579 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:12.694 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:12.747 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:12.865 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:12.970 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:13.024 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:13.143 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:13.254 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:13.312 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:13.437 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:13.547 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:13.607 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:13.731 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:13.838 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:13.891 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:14.017 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:14.126 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:14.179 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:14.302 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:14.407 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:14.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:14.590 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:14.694 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:14.751 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:14.869 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:14.973 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:15.027 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:15.153 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:15.259 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:15.314 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:15.439 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:15.546 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:15.599 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:15.729 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:15.834 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:15.887 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:16.006 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:16.110 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:16.164 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:16.284 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:16.390 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:16.454 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:16.571 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:16.678 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:16.731 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:16.851 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:16.963 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:17.028 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:17.168 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:17.297 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:17.365 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:17.512 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:17.638 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:17.710 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:17.863 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:17.982 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:18.040 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:18.159 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:18.272 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:18.327 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:18.449 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:18.558 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:18.611 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:18.733 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:18.838 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:18.891 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:19.014 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:19.119 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-19 zones={test-zone2, test-zone1} 2020-10-05T12:05:19.120 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-19 zones={test-zone3, test-zone1} 2020-10-05T12:05:19.129 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:05:19.137 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:05:19.138 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.138 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.139 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.139 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.139 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.139 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.140 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.140 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.140 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.141 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.141 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.141 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.141 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.142 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.142 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.142 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.146 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.146 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.146 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.147 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.147 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:05:19.154 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:05:19.155 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.155 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.156 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.156 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.156 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.156 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.157 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.157 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.157 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.158 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.158 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.158 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.158 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.159 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.159 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.159 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.160 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.160 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.160 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.161 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.161 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.161 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.161 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.162 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.162 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.162 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.163 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.163 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.163 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.164 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:19.182 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:05:19.191 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:05:19.261 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:05:19.317 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:19.368 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:19.485 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:19.589 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:19.643 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:19.761 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:19.865 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:19.919 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:20.037 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:20.148 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:20.204 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:20.319 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:20.430 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:20.495 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:20.617 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:20.725 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:20.780 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:20.898 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:21.002 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:21.055 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:21.173 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:21.277 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:21.334 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:21.449 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:21.553 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:21.607 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:21.724 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:21.834 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:21.886 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:22.002 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:22.106 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:22.159 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:22.280 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:22.394 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:22.447 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:22.572 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:22.677 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:22.731 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:22.853 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:22.957 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:23.016 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:23.137 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:23.246 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:23.305 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:23.426 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:23.529 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:23.583 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:23.706 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:23.817 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:23.871 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:23.992 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:24.097 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:24.150 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:24.263 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:24.366 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:24.418 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:24.538 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:24.646 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:24.703 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:24.829 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:24.934 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:24.986 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:25.106 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:25.217 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:25.271 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:25.388 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:25.493 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:25.547 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:25.665 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:25.774 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:25.830 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:25.946 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:26.058 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:26.112 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:26.233 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:26.338 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:26.392 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:26.511 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:26.619 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:26.675 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:26.793 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:26.897 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:26.952 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:27.072 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:27.177 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:27.232 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:27.348 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:27.454 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:27.515 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:27.642 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:27.746 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-19 zones={test-zone3, test-zone1} 2020-10-05T12:05:27.746 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-19 zones={test-zone3, test-zone2} 2020-10-05T12:05:27.757 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:05:27.765 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:05:27.766 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.766 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.767 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.767 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.767 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.768 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.768 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.768 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.769 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.770 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.770 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.770 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.771 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.771 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.771 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.772 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.772 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.772 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.773 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.773 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.774 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.774 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.775 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.775 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.775 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.776 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.776 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.776 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.777 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.777 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.778 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:05:27.789 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2020-10-05T12:05:27.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.790 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.790 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.790 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.791 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.791 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.792 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.792 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.792 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.793 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.793 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.793 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.794 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.794 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.794 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.795 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.795 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.795 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.796 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.796 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.796 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.797 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.797 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.797 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.798 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.798 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.798 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:27.822 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:05:27.831 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:05:27.901 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2020-10-05T12:05:27.965 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:28.019 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:28.141 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:28.247 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:28.302 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:28.420 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:28.527 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:28.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:28.712 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:28.819 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:28.875 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:29.000 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:29.108 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:29.163 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:29.288 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:29.400 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:29.455 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:29.573 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:29.680 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:29.734 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:29.853 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:29.962 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:30.014 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:30.131 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:30.239 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:30.295 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:30.417 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:30.523 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:30.578 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:30.695 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:30.803 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:30.859 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:30.984 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:31.096 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:31.151 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:31.273 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:31.383 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:31.439 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:31.560 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:31.667 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:31.723 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:31.843 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:31.952 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:32.007 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:32.127 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:32.231 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:32.288 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:32.408 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:32.515 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:32.571 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:32.751 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:32.934 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:33.037 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:33.215 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:33.328 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:33.384 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:33.507 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:33.611 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:33.668 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:33.791 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:33.899 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:33.955 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:34.078 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:34.183 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:34.239 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:34.367 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:34.475 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:34.530 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:34.650 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:34.755 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:34.815 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:34.935 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:35.043 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:35.099 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:35.221 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:35.323 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:35.379 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:35.496 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:35.611 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:35.666 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:35.783 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:35.891 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:35.947 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:36.068 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:36.179 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:36.234 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:36.351 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:36.455 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:36.511 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:36.633 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:36.739 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-19 zones={test-zone3, test-zone2} 2020-10-05T12:05:36.740 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:36.740 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:36.741 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:36.780 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:36.781 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:37.053 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:05:37.054 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:37.054 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:05:37.054 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:03:19.033064Z" 2020-10-05T12:05:37.054 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:37.054 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:37.055 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000000", 2020-10-05T12:05:37.055 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:05:37.055 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:37.055 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:37.055 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:05:37.055 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:02:44.575161Z" 2020-10-05T12:05:37.055 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:37.056 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:37.056 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000001310", 2020-10-05T12:05:37.056 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:04:47.046404Z" 2020-10-05T12:05:37.056 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:37.056 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:05:37.057 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2020-10-05T12:05:37.058 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:37.058 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:37.059 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:37.101 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:37.101 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:37.359 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:05:37.360 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:05:37.360 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:05:37.360 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:05:37.360 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:05:37.360 INFO:teuthology.orchestra.run.smithi081.stdout: "instance_id": 8907536789404842802 2020-10-05T12:05:37.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:37.361 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:05:37.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:37.361 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:05:37.361 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:37.361 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:05:37.361 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:05:37.362 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:37.362 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:37.362 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:37.362 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:19.033064Z" 2020-10-05T12:05:37.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:37.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:37.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:37.363 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:05:37.363 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:37.363 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:05:37.363 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000000000", 2020-10-05T12:05:37.363 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:37.363 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:37.363 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:37.364 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000" 2020-10-05T12:05:37.364 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:37.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:37.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:37.364 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:05:37.364 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:37.364 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:05:37.365 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:05:37.365 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:37.365 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:37.365 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:37.365 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:02:44.575161Z" 2020-10-05T12:05:37.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:37.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:37.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:37.366 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:05:37.366 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:37.366 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:05:37.366 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000001310", 2020-10-05T12:05:37.366 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:37.367 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:37.367 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:37.367 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:04:47.046404Z" 2020-10-05T12:05:37.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:37.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:37.367 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:05:37.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:37.367 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:05:37.368 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 0, 2020-10-05T12:05:37.368 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 0 2020-10-05T12:05:37.368 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:37.368 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:05:37.369 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2020-10-05T12:05:37.369 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:37.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:37.370 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:37.411 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:37.411 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:37.665 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:05:37.665 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:37.665 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:05:37.665 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:03:19.033064Z" 2020-10-05T12:05:37.666 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:37.666 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:37.666 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000000", 2020-10-05T12:05:37.666 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:05:37.666 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:37.666 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:37.666 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:05:37.667 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:02:44.575161Z" 2020-10-05T12:05:37.667 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:37.667 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:37.667 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000001310", 2020-10-05T12:05:37.667 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:04:47.046404Z" 2020-10-05T12:05:37.667 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:37.667 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:05:37.668 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2020-10-05T12:05:37.669 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:37.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:37.670 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:37.748 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:37.749 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:38.019 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:05:38.020 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:05:38.020 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:05:38.021 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:05:38.021 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:05:38.021 INFO:teuthology.orchestra.run.smithi158.stdout: "instance_id": 15500224595871940729 2020-10-05T12:05:38.022 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:38.022 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:05:38.022 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:38.023 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:05:38.023 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:38.023 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:38.024 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:05:38.025 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:38.025 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:38.025 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:38.026 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:19.033064Z" 2020-10-05T12:05:38.026 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:38.026 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:38.027 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:38.027 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:05:38.027 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:38.027 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:38.028 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000000", 2020-10-05T12:05:38.028 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:38.029 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:38.029 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:38.030 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000" 2020-10-05T12:05:38.031 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:38.032 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:38.033 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:38.035 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:05:38.036 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:38.036 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:38.036 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:05:38.037 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:38.037 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:38.037 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:38.037 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:02:44.575161Z" 2020-10-05T12:05:38.038 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:38.038 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:38.038 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:38.038 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:05:38.039 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:38.039 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:38.039 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000001310", 2020-10-05T12:05:38.040 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:38.040 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:38.040 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:38.040 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:04:47.046404Z" 2020-10-05T12:05:38.041 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:38.041 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:38.041 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:05:38.041 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:38.042 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:05:38.042 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 0, 2020-10-05T12:05:38.042 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 0 2020-10-05T12:05:38.043 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:38.043 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:05:38.045 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2020-10-05T12:05:38.046 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:38.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:38.047 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:38.134 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:38.134 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:38.387 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:05:38.388 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:38.388 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:05:38.388 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:03:19.033064Z" 2020-10-05T12:05:38.388 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:38.388 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:38.388 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000000", 2020-10-05T12:05:38.389 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:05:38.389 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:38.389 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:38.389 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:05:38.389 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:02:44.575161Z" 2020-10-05T12:05:38.389 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:38.389 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:38.390 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000001310", 2020-10-05T12:05:38.390 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:04:47.046404Z" 2020-10-05T12:05:38.390 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:38.390 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:05:38.391 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone4 source_zone=test-zone1 2020-10-05T12:05:38.392 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:38.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:38.392 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:38.441 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:38.442 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:38.702 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:05:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:05:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:05:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:05:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:05:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "instance_id": 6281930865008582443 2020-10-05T12:05:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:05:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:05:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:05:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:05:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:19.033064Z" 2020-10-05T12:05:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:05:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:05:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000000000", 2020-10-05T12:05:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000" 2020-10-05T12:05:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:05:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:05:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:05:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:02:44.575161Z" 2020-10-05T12:05:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:05:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:05:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000001310", 2020-10-05T12:05:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:04:47.046404Z" 2020-10-05T12:05:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:05:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:05:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 0, 2020-10-05T12:05:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 0 2020-10-05T12:05:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:38.710 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:05:38.711 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone4 source_zone=test-zone1 2020-10-05T12:05:38.712 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:38.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:38.713 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:38.793 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:39.039 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2020-10-05T12:05:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:05:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:03:41.218954Z" 2020-10-05T12:05:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000000000", 2020-10-05T12:05:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "0.000000" 2020-10-05T12:05:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000002640", 2020-10-05T12:05:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:02:35.209070Z" 2020-10-05T12:05:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000001310", 2020-10-05T12:05:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:04:47.232512Z" 2020-10-05T12:05:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:39.042 INFO:teuthology.orchestra.run.smithi081.stdout:] 2020-10-05T12:05:39.043 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2020-10-05T12:05:39.043 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:39.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:39.044 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:39.084 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:39.085 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:39.337 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:05:39.337 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:05:39.338 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:05:39.338 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:05:39.338 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:05:39.338 INFO:teuthology.orchestra.run.smithi158.stdout: "instance_id": 10955443425776689827 2020-10-05T12:05:39.338 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:39.338 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:05:39.338 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:39.339 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:05:39.339 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:39.339 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:39.339 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:05:39.339 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:39.339 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:39.339 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:39.340 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:41.218954Z" 2020-10-05T12:05:39.340 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:39.340 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:39.340 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:39.340 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:05:39.340 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:39.341 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:39.341 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000000", 2020-10-05T12:05:39.341 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:39.341 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:39.341 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:39.342 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000" 2020-10-05T12:05:39.342 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:39.342 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:39.342 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:39.342 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:05:39.342 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:39.343 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:39.343 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002640", 2020-10-05T12:05:39.343 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:39.343 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:39.343 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:39.343 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:02:35.209070Z" 2020-10-05T12:05:39.343 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:39.344 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:39.344 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:39.344 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:05:39.344 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:39.344 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:39.344 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000001310", 2020-10-05T12:05:39.344 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:39.345 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:39.345 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:39.345 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:04:47.232512Z" 2020-10-05T12:05:39.345 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:39.345 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:39.345 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:05:39.345 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:39.345 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:05:39.346 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 0, 2020-10-05T12:05:39.346 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 0 2020-10-05T12:05:39.346 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:39.346 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:05:39.347 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2020-10-05T12:05:39.347 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:39.348 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:39.348 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:39.386 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:39.387 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:39.641 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2020-10-05T12:05:39.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:39.642 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:05:39.642 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:03:41.218954Z" 2020-10-05T12:05:39.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:39.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:39.643 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000000000", 2020-10-05T12:05:39.643 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "0.000000" 2020-10-05T12:05:39.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:39.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:39.643 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000002640", 2020-10-05T12:05:39.643 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:02:35.209070Z" 2020-10-05T12:05:39.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:39.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:39.644 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000001310", 2020-10-05T12:05:39.644 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:04:47.232512Z" 2020-10-05T12:05:39.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:39.644 INFO:teuthology.orchestra.run.smithi081.stdout:] 2020-10-05T12:05:39.645 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone2 2020-10-05T12:05:39.646 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:39.646 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:39.647 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:39.688 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:39.689 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:39.933 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:05:39.933 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:05:39.933 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:05:39.933 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:05:39.934 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:05:39.934 INFO:teuthology.orchestra.run.smithi158.stdout: "instance_id": 2541289269092616888 2020-10-05T12:05:39.934 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:39.934 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:05:39.934 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:39.934 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:05:39.934 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:39.935 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:39.935 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:05:39.935 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:39.935 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:39.935 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:39.935 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:41.218954Z" 2020-10-05T12:05:39.935 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:39.936 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:39.936 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:39.936 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:05:39.936 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:39.936 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:39.936 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000000", 2020-10-05T12:05:39.936 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:39.937 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:39.937 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:39.937 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000" 2020-10-05T12:05:39.937 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:39.937 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:39.937 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:39.937 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:05:39.938 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:39.938 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:39.938 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002640", 2020-10-05T12:05:39.938 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:39.938 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:39.938 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:39.938 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:02:35.209070Z" 2020-10-05T12:05:39.939 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:39.939 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:39.939 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:39.939 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:05:39.939 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:39.939 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:39.939 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000001310", 2020-10-05T12:05:39.940 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:39.940 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:39.940 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:39.940 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:04:47.232512Z" 2020-10-05T12:05:39.940 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:39.940 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:39.940 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:05:39.941 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:39.941 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:05:39.941 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 0, 2020-10-05T12:05:39.941 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 0 2020-10-05T12:05:39.942 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:39.942 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:05:39.943 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone2 2020-10-05T12:05:39.943 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:39.944 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:39.944 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:40.027 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:40.028 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:40.287 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:05:40.288 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:40.288 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005167", 2020-10-05T12:05:40.288 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:03:41.181933Z" 2020-10-05T12:05:40.288 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:40.288 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:40.289 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000000", 2020-10-05T12:05:40.289 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:05:40.289 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:40.289 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:40.289 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:05:40.289 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:02:44.564209Z" 2020-10-05T12:05:40.289 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:40.290 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:40.290 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000001177", 2020-10-05T12:05:40.290 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:04:25.191310Z" 2020-10-05T12:05:40.290 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:40.290 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:05:40.291 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone3 2020-10-05T12:05:40.292 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone3', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:40.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone3', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:40.292 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone3 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:40.375 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:40.375 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:40.626 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:05:40.627 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:05:40.627 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:05:40.627 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:05:40.627 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:05:40.627 INFO:teuthology.orchestra.run.smithi158.stdout: "instance_id": 4570483896491121822 2020-10-05T12:05:40.628 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:40.628 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:05:40.628 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:40.628 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:05:40.628 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:40.628 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:40.628 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005167", 2020-10-05T12:05:40.629 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:40.629 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:40.629 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:40.629 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:41.181933Z" 2020-10-05T12:05:40.629 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:40.629 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:40.629 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:40.630 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:05:40.630 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:40.630 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:40.630 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000000", 2020-10-05T12:05:40.630 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:40.630 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:40.630 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:40.631 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000" 2020-10-05T12:05:40.631 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:40.631 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:40.631 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:40.631 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:05:40.631 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:40.631 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:40.632 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:05:40.632 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:40.632 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:40.632 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:40.632 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:02:44.564209Z" 2020-10-05T12:05:40.632 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:40.632 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:40.632 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:40.633 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:05:40.633 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:40.633 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:05:40.633 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000001177", 2020-10-05T12:05:40.633 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:40.633 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:40.633 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:40.634 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:04:25.191310Z" 2020-10-05T12:05:40.634 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:40.634 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:40.634 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:05:40.634 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:40.634 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:05:40.634 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 0, 2020-10-05T12:05:40.635 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 0 2020-10-05T12:05:40.635 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:40.635 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:05:40.636 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone3 2020-10-05T12:05:40.636 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:40.637 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:40.637 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:40.714 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:40.714 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:40.986 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:05:40.987 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:40.987 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005167", 2020-10-05T12:05:40.987 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:03:41.181933Z" 2020-10-05T12:05:40.987 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:40.987 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:40.987 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000000", 2020-10-05T12:05:40.988 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:05:40.988 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:40.988 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:40.988 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:05:40.988 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:02:44.564209Z" 2020-10-05T12:05:40.988 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:40.988 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:40.989 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000001177", 2020-10-05T12:05:40.989 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:04:25.191310Z" 2020-10-05T12:05:40.989 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:40.989 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:05:40.990 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone3 2020-10-05T12:05:40.990 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone3', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:40.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone3', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:40.991 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone3 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:41.032 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:41.032 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:41.273 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:05:41.274 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:05:41.274 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:05:41.274 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:05:41.274 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:05:41.274 INFO:teuthology.orchestra.run.smithi081.stdout: "instance_id": 14774154849435705122 2020-10-05T12:05:41.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:41.275 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:05:41.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:41.275 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:05:41.275 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:41.275 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:05:41.276 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000005167", 2020-10-05T12:05:41.276 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:41.276 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:41.276 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:41.276 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:41.181933Z" 2020-10-05T12:05:41.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:41.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:41.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:41.277 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:05:41.277 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:41.277 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:05:41.277 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000000000", 2020-10-05T12:05:41.277 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:41.277 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:41.277 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:41.278 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000" 2020-10-05T12:05:41.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:41.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:41.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:41.278 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:05:41.278 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:41.278 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:05:41.279 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:05:41.279 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:41.279 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:41.279 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:41.279 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:02:44.564209Z" 2020-10-05T12:05:41.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:41.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:41.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:41.280 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:05:41.280 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:41.280 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:05:41.280 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000001177", 2020-10-05T12:05:41.280 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:41.280 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:41.281 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:41.281 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:04:25.191310Z" 2020-10-05T12:05:41.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:41.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:41.281 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:05:41.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:41.281 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:05:41.282 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 0, 2020-10-05T12:05:41.282 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 0 2020-10-05T12:05:41.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:41.282 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:05:41.283 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone3 2020-10-05T12:05:41.284 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_concurrent_versioned_object_incremental_sync ... ok 2020-10-05T12:05:41.321 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:41.322 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:41.323 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:41.359 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:41.359 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:41.573 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T12:05:41.606 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:05:41.606 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:41.606 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899541.316365_259.1", 2020-10-05T12:05:41.607 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:05:41.316365Z" 2020-10-05T12:05:41.607 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:41.607 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:41.607 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:05:41.607 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:02.535244Z" 2020-10-05T12:05:41.607 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:41.607 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:41.608 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:05:41.608 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:05:41.608 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:41.608 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:41.608 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:05:41.608 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:05:41.608 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:41.609 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:05:41.609 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T12:05:41.610 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:41.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:41.611 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:41.651 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:41.892 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:05:41.892 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:05:41.892 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:05:41.892 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:05:41.892 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:05:41.893 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:05:41.893 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:41.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:41.893 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:05:41.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:41.893 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:05:41.893 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:41.894 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:41.894 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899541.316365_259.1", 2020-10-05T12:05:41.894 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:41.894 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:05:41.894 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:41.894 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:41.316365Z", 2020-10-05T12:05:41.894 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:41.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:41.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:41.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:41.895 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:05:41.895 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:41.895 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:41.895 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:05:41.896 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:41.896 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:41.896 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:41.896 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:05:41.896 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:41.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:41.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:41.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:41.897 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:05:41.897 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:41.897 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:41.897 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:05:41.897 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:41.897 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:41.897 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:41.898 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:05:41.898 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:41.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:41.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:41.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:41.898 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:05:41.898 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:41.899 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:41.899 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:05:41.899 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:41.899 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:41.899 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:41.899 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:05:41.899 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:41.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:41.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:41.900 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:05:41.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:41.900 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:05:41.900 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:05:41.900 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:05:41.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:41.901 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:05:41.902 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T12:05:41.902 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T12:05:41.902 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:41.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:41.903 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:41.944 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:41.944 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:42.179 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:05:42.179 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:05:42.179 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:05:42.180 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:05:42.180 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:05:42.180 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:05:42.180 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:05:42.180 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:42.180 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:05:42.180 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:42.181 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:05:42.181 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:42.181 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:05:42.181 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899541.316365_259.1", 2020-10-05T12:05:42.181 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:42.181 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T12:05:42.181 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:42.182 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:05:41.316365Z", 2020-10-05T12:05:42.182 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:05:42.182 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:42.182 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:42.182 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:42.182 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:05:42.182 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:42.183 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:05:42.183 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:05:42.183 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:42.183 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:42.184 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:42.184 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:05:42.184 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:05:42.184 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:42.185 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:42.185 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:42.185 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:05:42.186 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:42.186 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:05:42.186 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:05:42.186 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:42.187 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:42.187 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:42.187 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:05:42.188 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:05:42.188 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:42.188 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:42.188 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:42.189 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:05:42.189 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:42.189 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:05:42.189 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:05:42.190 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:42.190 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:42.190 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:42.190 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:05:42.190 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:05:42.191 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:42.191 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:42.191 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:05:42.192 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:42.192 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:05:42.192 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T12:05:42.192 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T12:05:42.193 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:42.193 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:05:42.194 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T12:05:42.195 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T12:05:42.196 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:42.197 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:42.198 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:42.597 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:05:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:05:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:05:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:05:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:05:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:05:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:05:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:05:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899541.316365_259.1", 2020-10-05T12:05:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:05:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:41.316365Z", 2020-10-05T12:05:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:05:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:05:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:05:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:05:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:05:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:05:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:05:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:05:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:05:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:05:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:05:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:05:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:05:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:42.614 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:05:42.615 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T12:05:42.667 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:42.667 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:42.668 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:05:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:05:42.944+0000 7fc79d8ba0c0 1 bucket sync caught up with source: 2020-10-05T12:05:42.947 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000001.34.5, , ] 2020-10-05T12:05:42.948 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000001.34.5, , ] 2020-10-05T12:05:42.948 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:05:42.944+0000 7fc79d8ba0c0 0 bucket checkpoint complete 2020-10-05T12:05:42.972 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:42.973 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:42.973 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:05:43.018 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:43.018 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:43.232 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:43.226+0000 7f24456750c0 1 bucket sync caught up with source: 2020-10-05T12:05:43.233 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.34.5, , ] 2020-10-05T12:05:43.233 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000001.34.5, , ] 2020-10-05T12:05:43.233 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:43.226+0000 7f24456750c0 0 bucket checkpoint complete 2020-10-05T12:05:43.258 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:43.259 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:43.259 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:05:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:43.552 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:05:43.548+0000 7fea27c7a0c0 1 bucket sync caught up with source: 2020-10-05T12:05:43.552 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000001.34.5, , ] 2020-10-05T12:05:43.552 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000001.34.5, , ] 2020-10-05T12:05:43.553 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:05:43.548+0000 7fea27c7a0c0 0 bucket checkpoint complete 2020-10-05T12:05:43.677 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:43.677 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:43.678 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:05:43.724 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:43.725 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:43.953 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:43.946+0000 7f72e1ef80c0 1 bucket sync caught up with source: 2020-10-05T12:05:43.953 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.23.5, , ] 2020-10-05T12:05:43.953 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000001.23.5, , ] 2020-10-05T12:05:43.954 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:43.946+0000 7f72e1ef80c0 0 bucket checkpoint complete 2020-10-05T12:05:43.983 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:43.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:43.984 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:05:44.072 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:44.073 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:44.310 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:44.306+0000 7fafbbf090c0 1 bucket sync caught up with source: 2020-10-05T12:05:44.310 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.23.5, , ] 2020-10-05T12:05:44.310 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000001.23.5, , ] 2020-10-05T12:05:44.311 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:44.306+0000 7fafbbf090c0 0 bucket checkpoint complete 2020-10-05T12:05:44.342 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:44.343 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:44.343 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:05:44.392 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:44.393 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:44.607 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:44.602+0000 7f046f3d80c0 1 bucket sync caught up with source: 2020-10-05T12:05:44.608 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.19.5, , ] 2020-10-05T12:05:44.608 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000001.19.5, , ] 2020-10-05T12:05:44.609 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:05:44.602+0000 7f046f3d80c0 0 bucket checkpoint complete 2020-10-05T12:05:44.635 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:44.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:44.636 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:05:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:44.915 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:05:44.912+0000 7f107197f0c0 1 bucket sync caught up with source: 2020-10-05T12:05:44.915 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000001.19.5, , ] 2020-10-05T12:05:44.915 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000001.19.5, , ] 2020-10-05T12:05:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:05:44.912+0000 7f107197f0c0 0 bucket checkpoint complete 2020-10-05T12:05:44.949 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-20 zones={test-zone2, test-zone1} 2020-10-05T12:05:44.960 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:05:45.010 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:45.011 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:05:45.019 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:45.077 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:45.088 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:45.155 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:45.218 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-20 zones={test-zone2, test-zone1} 2020-10-05T12:05:45.219 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-20 zones={test-zone3, test-zone1} 2020-10-05T12:05:45.229 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:05:45.274 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:45.275 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:05:45.282 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:45.336 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:45.346 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:45.412 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:45.468 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-20 zones={test-zone3, test-zone1} 2020-10-05T12:05:45.469 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-20 zones={test-zone3, test-zone2} 2020-10-05T12:05:45.479 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:05:45.526 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:45.527 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:05:45.534 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:05:45.593 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:45.605 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:45.670 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:05:45.728 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-20 zones={test-zone3, test-zone2} 2020-10-05T12:05:45.743 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:45.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:45.744 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:45.782 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:45.783 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:46.004 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T12:05:46.035 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:05:46.035 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:46.035 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899545.740215_264.1", 2020-10-05T12:05:46.035 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:05:45.740215Z" 2020-10-05T12:05:46.036 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:46.036 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:46.036 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:05:46.036 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:02.535244Z" 2020-10-05T12:05:46.036 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:46.036 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:46.037 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:05:46.037 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:05:46.037 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:46.037 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:46.037 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:05:46.037 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:05:46.037 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:46.037 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:05:46.038 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T12:05:46.039 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:46.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:46.040 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:46.323 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:05:46.324 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:05:46.324 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:05:46.324 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:05:46.325 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:05:46.325 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:05:46.325 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:46.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:46.325 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:05:46.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:46.326 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:05:46.326 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:46.326 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:46.326 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899545.740215_264.1", 2020-10-05T12:05:46.326 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:46.326 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:05:46.326 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:46.327 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:45.740215Z", 2020-10-05T12:05:46.327 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:46.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:46.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:46.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:46.327 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:05:46.327 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:46.328 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:46.328 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:05:46.328 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:46.328 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:46.328 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:46.328 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:05:46.328 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:46.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:46.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:46.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:46.329 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:05:46.329 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:46.329 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:46.329 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:05:46.329 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:46.330 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:46.330 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:46.330 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:05:46.330 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:46.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:46.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:46.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:46.331 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:05:46.331 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:46.331 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:46.331 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:05:46.331 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:46.331 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:46.331 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:46.331 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:05:46.332 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:46.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:46.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:46.332 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:05:46.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:46.332 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:05:46.332 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:05:46.333 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:05:46.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:46.333 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:05:46.334 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T12:05:46.334 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T12:05:46.335 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:46.335 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:46.335 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:46.374 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:46.375 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:46.609 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:05:46.610 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:05:46.610 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:05:46.610 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:05:46.610 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:05:46.610 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:05:46.610 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:05:46.611 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:46.611 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:05:46.611 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:46.611 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:05:46.611 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:46.611 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:05:46.611 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899545.740215_264.1", 2020-10-05T12:05:46.612 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:46.612 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T12:05:46.612 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:46.612 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:05:45.740215Z", 2020-10-05T12:05:46.612 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:05:46.612 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:46.612 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:46.613 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:46.613 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:05:46.613 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:46.613 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:05:46.613 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:05:46.613 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:46.613 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:46.613 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:46.614 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:05:46.614 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:05:46.614 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:46.614 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:46.614 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:46.614 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:05:46.614 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:46.615 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:05:46.615 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:05:46.615 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:46.615 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:46.615 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:46.615 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:05:46.615 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:05:46.616 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:46.616 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:46.616 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:05:46.616 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:05:46.616 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:05:46.616 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:05:46.616 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:05:46.617 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:05:46.617 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:05:46.617 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:05:46.617 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:05:46.617 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:05:46.617 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:46.617 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:46.618 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:05:46.618 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:05:46.618 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:05:46.618 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T12:05:46.619 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T12:05:46.619 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:05:46.619 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:05:46.620 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T12:05:46.620 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T12:05:46.621 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:46.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:05:46.622 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:05:46.662 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:46.662 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:47.027 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:05:47.027 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:05:47.027 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:05:47.028 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:05:47.028 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:05:47.028 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:05:47.028 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:47.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:47.028 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:05:47.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:47.029 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:05:47.029 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:47.029 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:47.029 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899545.740215_264.1", 2020-10-05T12:05:47.029 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:47.029 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:05:47.030 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:47.030 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:45.740215Z", 2020-10-05T12:05:47.030 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:47.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:47.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:47.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:47.030 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:05:47.031 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:47.031 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:47.031 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:05:47.031 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:47.031 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:47.031 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:47.031 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:05:47.031 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:47.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:47.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:47.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:47.032 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:05:47.032 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:47.032 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:47.032 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:05:47.033 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:47.033 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:47.033 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:47.033 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:05:47.033 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:47.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:47.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:47.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:05:47.034 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:05:47.034 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:05:47.034 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:05:47.034 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:05:47.034 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:05:47.034 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:05:47.035 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:05:47.035 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:05:47.035 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:05:47.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:47.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:47.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:05:47.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:05:47.036 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:05:47.036 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:05:47.036 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:05:47.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:05:47.036 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:05:47.037 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T12:05:47.086 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:47.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:05:47.087 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:05:47.134 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:05:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:05:47.362 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:05:47.359+0000 7f43bdef60c0 1 waiting for incremental sync to catch up: 2020-10-05T12:05:47.363 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000001.34.5, , ] 2020-10-05T12:05:47.363 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000003.37.12, , ] 2020-10-05T12:05:52.367 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:05:52.363+0000 7f43bdef60c0 1 waiting for incremental sync to catch up: 2020-10-05T12:05:52.367 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000001.34.5, , ] 2020-10-05T12:05:52.367 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000003.37.12, , ] 2020-10-05T12:05:57.371 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:05:57.367+0000 7f43bdef60c0 1 waiting for incremental sync to catch up: 2020-10-05T12:05:57.371 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000001.34.5, , ] 2020-10-05T12:05:57.371 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000003.37.12, , ] 2020-10-05T12:06:02.375 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:06:02.371+0000 7f43bdef60c0 1 waiting for incremental sync to catch up: 2020-10-05T12:06:02.376 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000001.34.5, , ] 2020-10-05T12:06:02.376 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000003.37.12, , ] 2020-10-05T12:06:07.379 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:06:07.375+0000 7f43bdef60c0 1 bucket sync caught up with source: 2020-10-05T12:06:07.380 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000003.37.12, , ] 2020-10-05T12:06:07.380 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000003.37.12, , ] 2020-10-05T12:06:07.380 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:06:07.375+0000 7f43bdef60c0 0 bucket checkpoint complete 2020-10-05T12:06:07.411 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:07.411 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:07.412 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:06:07.459 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:06:07.460 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:06:07.704 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:07.698+0000 7f0e5cbda0c0 1 bucket sync caught up with source: 2020-10-05T12:06:07.705 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000003.37.12, , ] 2020-10-05T12:06:07.705 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000003.37.12, , ] 2020-10-05T12:06:07.705 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:07.698+0000 7f0e5cbda0c0 0 bucket checkpoint complete 2020-10-05T12:06:07.729 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:07.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:07.730 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:06:07.777 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:06:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:06:08.004 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:06:07.999+0000 7f83204a00c0 1 bucket sync caught up with source: 2020-10-05T12:06:08.004 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000003.37.12, , ] 2020-10-05T12:06:08.004 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000003.37.12, , ] 2020-10-05T12:06:08.004 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:06:07.999+0000 7f83204a00c0 0 bucket checkpoint complete 2020-10-05T12:06:08.042 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:08.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:08.043 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:06:08.091 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:06:08.092 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:06:08.320 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:08.314+0000 7fb7e106f0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:06:08.321 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.23.5, , ] 2020-10-05T12:06:08.321 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000003.27.12, , ] 2020-10-05T12:06:13.323 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:13.318+0000 7fb7e106f0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:06:13.324 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.23.5, , ] 2020-10-05T12:06:13.324 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000003.27.12, , ] 2020-10-05T12:06:18.327 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:18.322+0000 7fb7e106f0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:06:18.327 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.23.5, , ] 2020-10-05T12:06:18.327 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000003.27.12, , ] 2020-10-05T12:06:23.330 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:23.326+0000 7fb7e106f0c0 1 bucket sync caught up with source: 2020-10-05T12:06:23.331 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000004.29.9, , ] 2020-10-05T12:06:23.331 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000003.27.12, , ] 2020-10-05T12:06:23.331 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:23.326+0000 7fb7e106f0c0 0 bucket checkpoint complete 2020-10-05T12:06:23.359 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:23.360 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:23.360 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:06:23.403 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:06:23.403 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:06:23.638 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:23.634+0000 7f58b0db80c0 1 bucket sync caught up with source: 2020-10-05T12:06:23.639 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000004.29.9, , ] 2020-10-05T12:06:23.639 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000004.29.9, , ] 2020-10-05T12:06:23.639 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:23.634+0000 7f58b0db80c0 0 bucket checkpoint complete 2020-10-05T12:06:23.669 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:23.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:23.670 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:06:23.760 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:06:23.760 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:06:23.993 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:23.990+0000 7fbcbce2b0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:06:23.994 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000003.23.12, , ] 2020-10-05T12:06:23.994 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000004.25.9, , ] 2020-10-05T12:06:28.997 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:28.990+0000 7fbcbce2b0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:06:28.998 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000003.23.12, , ] 2020-10-05T12:06:28.998 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000004.25.9, , ] 2020-10-05T12:06:34.002 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:33.997+0000 7fbcbce2b0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:06:34.002 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000003.23.12, , ] 2020-10-05T12:06:34.002 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000004.25.9, , ] 2020-10-05T12:06:39.006 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:39.001+0000 7fbcbce2b0c0 1 waiting for incremental sync to catch up: 2020-10-05T12:06:39.006 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000003.23.12, , ] 2020-10-05T12:06:39.007 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000004.25.9, , ] 2020-10-05T12:06:44.010 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:44.005+0000 7fbcbce2b0c0 1 bucket sync caught up with source: 2020-10-05T12:06:44.011 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000004.25.9, , ] 2020-10-05T12:06:44.011 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000004.25.9, , ] 2020-10-05T12:06:44.011 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:44.005+0000 7fbcbce2b0c0 0 bucket checkpoint complete 2020-10-05T12:06:44.038 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:44.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:44.039 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:06:44.087 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:06:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:06:44.322 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:06:44.318+0000 7f6c75e6e0c0 1 bucket sync caught up with source: 2020-10-05T12:06:44.322 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000004.25.9, , ] 2020-10-05T12:06:44.322 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000004.25.9, , ] 2020-10-05T12:06:44.323 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:06:44.318+0000 7f6c75e6e0c0 0 bucket checkpoint complete 2020-10-05T12:06:44.348 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-20 zones={test-zone2, test-zone1} 2020-10-05T12:06:44.359 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:06:44.406 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:06:44.407 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:06:44.408 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:06:44.414 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:06:44.415 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:06:44.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:44.478 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:44.543 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:44.600 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:44.610 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:44.674 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:44.731 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-20 zones={test-zone2, test-zone1} 2020-10-05T12:06:44.731 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-20 zones={test-zone3, test-zone1} 2020-10-05T12:06:44.738 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:06:44.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:06:44.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:06:44.788 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:06:44.796 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:06:44.796 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:06:44.849 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:44.859 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:44.927 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:44.985 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:44.994 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:45.059 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:45.116 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-20 zones={test-zone3, test-zone1} 2020-10-05T12:06:45.117 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-20 zones={test-zone3, test-zone2} 2020-10-05T12:06:45.127 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:06:45.174 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:06:45.175 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:06:45.176 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:06:45.183 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:06:45.184 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:06:45.246 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:45.258 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:45.324 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:45.380 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:45.391 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:45.461 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:06:45.525 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-20 zones={test-zone3, test-zone2} 2020-10-05T12:06:45.542 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:06:45.542 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:06:45.543 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:06:45.580 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:06:45.581 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:06:45.779 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T12:06:45.811 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:06:45.812 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:06:45.812 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899605.537934_277.1", 2020-10-05T12:06:45.812 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:06:45.537934Z" 2020-10-05T12:06:45.812 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:06:45.812 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:06:45.813 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:06:45.813 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:02.535244Z" 2020-10-05T12:06:45.813 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:06:45.813 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:06:45.813 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:06:45.813 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:06:45.813 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:06:45.814 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:06:45.814 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:06:45.814 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:06:45.814 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:06:45.814 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:06:45.815 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T12:06:45.816 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:06:45.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:06:45.816 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:06:45.854 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:06:45.855 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:06:46.103 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:06:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:06:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:06:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:06:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:06:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:06:46.105 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:06:46.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:06:46.105 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:06:46.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:06:46.105 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:06:46.105 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:06:46.105 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:06:46.106 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899605.537934_277.1", 2020-10-05T12:06:46.106 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:06:46.106 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:06:46.106 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:06:46.106 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:06:45.537934Z", 2020-10-05T12:06:46.106 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:06:46.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:06:46.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:06:46.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:06:46.107 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:06:46.107 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:06:46.107 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:06:46.107 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:06:46.107 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:06:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:06:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:06:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:06:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:06:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:06:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:06:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:06:46.108 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:06:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:06:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:06:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:06:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:06:46.109 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:06:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:06:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:06:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:06:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:06:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:06:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:06:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:06:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:06:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:06:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:06:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:06:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:06:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:06:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:06:46.111 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:06:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:06:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:06:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:06:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:06:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:06:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:06:46.112 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:06:46.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:06:46.113 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:06:46.114 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T12:06:46.114 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T12:06:46.115 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:06:46.115 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:06:46.115 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:06:46.154 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:06:46.155 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:06:46.404 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:06:46.404 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:06:46.405 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:06:46.405 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:06:46.405 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:06:46.405 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:06:46.405 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:06:46.405 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:06:46.406 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:06:46.406 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:06:46.406 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:06:46.406 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:06:46.406 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:06:46.406 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899605.537934_277.1", 2020-10-05T12:06:46.406 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:06:46.407 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T12:06:46.407 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:06:46.407 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:06:45.537934Z", 2020-10-05T12:06:46.407 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:06:46.407 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:06:46.407 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:06:46.407 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:06:46.408 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:06:46.408 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:06:46.408 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:06:46.408 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:06:46.408 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:06:46.408 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:06:46.408 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:06:46.409 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:06:46.409 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:06:46.409 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:06:46.409 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:06:46.409 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:06:46.409 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:06:46.409 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:06:46.410 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:06:46.410 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:06:46.410 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:06:46.410 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:06:46.410 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:06:46.410 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:06:46.410 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:06:46.411 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:06:46.411 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:06:46.411 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:06:46.411 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:06:46.411 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:06:46.411 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:06:46.411 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:06:46.412 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:06:46.412 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:06:46.412 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:06:46.412 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:06:46.412 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:06:46.412 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:06:46.412 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:06:46.413 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:06:46.413 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:06:46.413 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:06:46.413 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T12:06:46.413 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T12:06:46.413 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:06:46.413 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:06:46.415 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T12:06:46.415 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T12:06:46.415 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:06:46.416 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:06:46.416 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:06:46.455 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:06:46.456 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:06:46.726 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:06:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:06:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:06:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:06:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:06:46.727 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:06:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:06:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:06:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:06:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:06:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:06:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:06:46.728 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:06:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899605.537934_277.1", 2020-10-05T12:06:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:06:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:06:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:06:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:06:45.537934Z", 2020-10-05T12:06:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:06:46.729 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:06:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:06:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:06:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:06:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:06:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:06:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:06:46.730 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:06:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:06:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:06:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:06:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:06:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:06:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:06:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:06:46.731 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:06:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:06:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:06:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:06:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:06:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:06:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:06:46.732 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:06:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:06:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:06:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:06:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:06:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:06:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:06:46.733 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:06:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:06:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:06:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:06:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:06:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:06:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:06:46.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:06:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:06:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:06:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:06:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:06:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:06:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:06:46.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:06:46.736 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:06:46.736 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T12:06:46.786 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:46.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:46.787 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:06:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:06:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:06:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:06:47.054+0000 7f3f7dab70c0 1 bucket sync caught up with source: 2020-10-05T12:06:47.062 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000005.41.17, , ] 2020-10-05T12:06:47.062 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000005.41.17, , ] 2020-10-05T12:06:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:06:47.054+0000 7f3f7dab70c0 0 bucket checkpoint complete 2020-10-05T12:06:47.091 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:47.092 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:47.092 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:06:47.139 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:06:47.139 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:06:47.375 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:47.369+0000 7fa1960910c0 1 bucket sync caught up with source: 2020-10-05T12:06:47.376 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000005.41.17, , ] 2020-10-05T12:06:47.376 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000005.41.17, , ] 2020-10-05T12:06:47.376 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:47.369+0000 7fa1960910c0 0 bucket checkpoint complete 2020-10-05T12:06:47.397 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:47.398 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:47.398 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:06:47.445 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:06:47.446 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:06:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:06:47.686+0000 7f7fb25590c0 1 bucket sync caught up with source: 2020-10-05T12:06:47.692 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000005.41.17, , ] 2020-10-05T12:06:47.692 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000005.41.17, , ] 2020-10-05T12:06:47.692 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:06:47.686+0000 7f7fb25590c0 0 bucket checkpoint complete 2020-10-05T12:06:47.817 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:47.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:06:47.819 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:06:47.866 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:06:47.866 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:06:48.101 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:48.093+0000 7f341aec20c0 1 waiting for incremental sync to catch up: 2020-10-05T12:06:48.101 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000004.29.9, , ] 2020-10-05T12:06:48.101 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000006.34.17, , ] 2020-10-05T12:06:53.105 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:53.097+0000 7f341aec20c0 1 waiting for incremental sync to catch up: 2020-10-05T12:06:53.105 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000004.29.9, , ] 2020-10-05T12:06:53.105 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000006.34.17, , ] 2020-10-05T12:06:58.108 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:06:58.101+0000 7f341aec20c0 1 waiting for incremental sync to catch up: 2020-10-05T12:06:58.109 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000004.29.9, , ] 2020-10-05T12:06:58.109 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000006.34.17, , ] 2020-10-05T12:07:03.112 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:03.105+0000 7f341aec20c0 1 waiting for incremental sync to catch up: 2020-10-05T12:07:03.112 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000004.29.9, , ] 2020-10-05T12:07:03.112 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000006.34.17, , ] 2020-10-05T12:07:08.115 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:08.109+0000 7f341aec20c0 1 bucket sync caught up with source: 2020-10-05T12:07:08.116 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000007.36.14, , ] 2020-10-05T12:07:08.116 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000006.34.17, , ] 2020-10-05T12:07:08.116 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:08.109+0000 7f341aec20c0 0 bucket checkpoint complete 2020-10-05T12:07:08.146 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:08.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:08.148 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:08.193 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:08.193 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:08.426 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:08.421+0000 7f5369eff0c0 1 bucket sync caught up with source: 2020-10-05T12:07:08.427 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000007.36.14, , ] 2020-10-05T12:07:08.427 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000007.36.14, , ] 2020-10-05T12:07:08.427 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:08.421+0000 7f5369eff0c0 0 bucket checkpoint complete 2020-10-05T12:07:08.455 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:08.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:08.456 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:08.541 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:08.541 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:08.783 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:08.777+0000 7f7b2eac70c0 1 waiting for incremental sync to catch up: 2020-10-05T12:07:08.783 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000006.30.17, , ] 2020-10-05T12:07:08.783 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000007.32.14, , ] 2020-10-05T12:07:13.786 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:13.781+0000 7f7b2eac70c0 1 waiting for incremental sync to catch up: 2020-10-05T12:07:13.787 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000006.30.17, , ] 2020-10-05T12:07:13.787 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000007.32.14, , ] 2020-10-05T12:07:18.790 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:18.785+0000 7f7b2eac70c0 1 waiting for incremental sync to catch up: 2020-10-05T12:07:18.791 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000006.30.17, , ] 2020-10-05T12:07:18.791 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000007.32.14, , ] 2020-10-05T12:07:23.794 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:23.789+0000 7f7b2eac70c0 1 bucket sync caught up with source: 2020-10-05T12:07:23.795 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000007.32.14, , ] 2020-10-05T12:07:23.795 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000007.32.14, , ] 2020-10-05T12:07:23.795 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:23.789+0000 7f7b2eac70c0 0 bucket checkpoint complete 2020-10-05T12:07:23.828 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:23.829 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-20', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:23.829 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-20 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:24.114 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:24.110+0000 7faf83a250c0 1 bucket sync caught up with source: 2020-10-05T12:07:24.115 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000007.32.14, , ] 2020-10-05T12:07:24.115 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000007.32.14, , ] 2020-10-05T12:07:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:24.110+0000 7faf83a250c0 0 bucket checkpoint complete 2020-10-05T12:07:24.145 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-20 zones={test-zone2, test-zone1} 2020-10-05T12:07:24.157 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:24.210 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:24.212 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:24.212 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:24.220 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:24.220 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:24.277 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:24.288 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:24.353 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:24.414 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:24.423 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:24.484 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:24.544 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-20 zones={test-zone2, test-zone1} 2020-10-05T12:07:24.545 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-20 zones={test-zone3, test-zone1} 2020-10-05T12:07:24.554 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:24.598 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:24.599 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:24.599 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:24.606 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:24.607 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:24.664 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:24.674 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:24.736 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:24.792 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:24.802 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:24.866 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:24.924 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-20 zones={test-zone3, test-zone1} 2020-10-05T12:07:24.925 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-20 zones={test-zone3, test-zone2} 2020-10-05T12:07:24.935 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:24.982 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:24.983 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:24.983 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:24.990 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:24.991 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:25.045 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:25.055 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:25.117 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:25.176 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:25.188 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:25.254 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:25.321 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-20 zones={test-zone3, test-zone2} 2020-10-05T12:07:25.321 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_version_suspended_incremental_sync ... ok 2020-10-05T12:07:25.322 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-21 2020-10-05T12:07:25.358 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-22 2020-10-05T12:07:25.433 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=dzadif-23 2020-10-05T12:07:25.523 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:25.775 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:25.777 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:25.836 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:25.837 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:26.059 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T12:07:26.095 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:07:26.096 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:26.096 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899645.514287_298.1", 2020-10-05T12:07:26.096 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:07:25.514287Z" 2020-10-05T12:07:26.096 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:26.096 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:26.097 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:26.097 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:02.535244Z" 2020-10-05T12:07:26.097 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:26.097 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:26.097 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:26.097 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:07:26.097 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:26.098 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:26.098 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:26.098 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:07:26.098 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:26.098 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:07:26.099 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T12:07:26.100 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:26.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:26.100 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:26.405 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:07:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:07:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:07:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:07:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:07:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:07:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:07:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:07:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899645.514287_298.1", 2020-10-05T12:07:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:07:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.514287Z", 2020-10-05T12:07:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:07:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:07:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:07:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:07:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:07:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:07:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:07:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:07:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:26.414 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:07:26.415 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T12:07:26.415 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T12:07:26.416 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:26.416 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:26.417 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:26.460 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:26.460 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:26.715 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:07:26.716 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:07:26.716 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:07:26.716 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:07:26.716 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:07:26.716 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:07:26.716 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:26.717 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:26.717 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:07:26.717 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:26.717 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:07:26.717 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:26.717 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:26.717 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899645.514287_298.1", 2020-10-05T12:07:26.718 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:26.718 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T12:07:26.718 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:26.718 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.514287Z", 2020-10-05T12:07:26.718 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:26.718 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:26.718 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:26.719 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:26.719 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:07:26.719 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:26.719 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:26.719 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:26.719 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:26.719 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:07:26.720 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:26.720 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:07:26.720 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:26.720 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:26.720 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:26.720 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:26.720 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:07:26.721 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:26.721 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:26.721 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:26.721 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:26.721 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:07:26.721 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:26.721 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:07:26.721 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:26.722 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:26.722 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:26.722 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:26.722 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:07:26.722 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:26.722 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:26.722 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:26.723 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:26.723 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:07:26.723 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:26.723 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:07:26.723 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:26.723 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:26.724 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:26.724 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:07:26.724 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:26.724 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:07:26.724 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T12:07:26.724 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T12:07:26.725 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:26.725 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:07:26.726 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T12:07:26.727 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T12:07:26.727 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:26.728 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:26.728 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:26.768 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:26.769 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:27.033 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:07:27.034 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:07:27.034 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:07:27.034 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:07:27.034 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:07:27.034 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:07:27.034 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:27.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:27.035 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:07:27.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:27.035 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:07:27.035 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:27.035 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:27.035 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899645.514287_298.1", 2020-10-05T12:07:27.035 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:27.036 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:07:27.036 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:27.036 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.514287Z", 2020-10-05T12:07:27.036 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:27.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:27.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:27.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:27.037 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:07:27.037 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:27.037 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:27.037 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:27.037 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:27.037 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:27.037 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:27.038 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:07:27.038 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:27.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:27.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:27.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:27.038 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:07:27.038 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:27.039 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:07:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:27.040 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:07:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:07:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:07:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:07:27.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:27.042 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:07:27.043 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T12:07:27.259 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-21', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:27.260 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-21', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:27.260 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-21 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:27.533 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:27.526+0000 7fb7175ad0c0 1 bucket sync caught up with source: 2020-10-05T12:07:27.533 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000003.22.11, , ] 2020-10-05T12:07:27.533 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000003.22.11, , ] 2020-10-05T12:07:27.533 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:27.526+0000 7fb7175ad0c0 0 bucket checkpoint complete 2020-10-05T12:07:27.568 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-21', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:27.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-21', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:27.569 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-21 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:27.615 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:27.616 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:27.828 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:27.821+0000 7f70475290c0 1 bucket sync caught up with source: 2020-10-05T12:07:27.828 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000003.22.11, , ] 2020-10-05T12:07:27.828 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000003.22.11, , ] 2020-10-05T12:07:27.828 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:27.821+0000 7f70475290c0 0 bucket checkpoint complete 2020-10-05T12:07:27.857 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-21', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:27.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-21', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:27.858 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-21 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:27.905 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:27.906 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:28.142+0000 7f9e5a6eb0c0 1 bucket sync caught up with source: 2020-10-05T12:07:28.147 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000003.22.11, , ] 2020-10-05T12:07:28.147 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000003.22.11, , ] 2020-10-05T12:07:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:28.142+0000 7f9e5a6eb0c0 0 bucket checkpoint complete 2020-10-05T12:07:28.275 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-21', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:28.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-21', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:28.276 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-21 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:28.323 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:28.324 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:28.562 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:28.557+0000 7f2dd22640c0 1 bucket sync caught up with source: 2020-10-05T12:07:28.562 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000002.46.5, , ] 2020-10-05T12:07:28.562 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000002.46.5, , ] 2020-10-05T12:07:28.563 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:28.557+0000 7f2dd22640c0 0 bucket checkpoint complete 2020-10-05T12:07:28.593 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-21', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:28.594 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-21', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:28.594 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-21 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:28.640 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:28.640 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:28.884 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:28.877+0000 7fdc629210c0 1 bucket sync caught up with source: 2020-10-05T12:07:28.884 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000002.46.5, , ] 2020-10-05T12:07:28.884 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000002.46.5, , ] 2020-10-05T12:07:28.885 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:28.877+0000 7fdc629210c0 0 bucket checkpoint complete 2020-10-05T12:07:28.915 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-21', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:28.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-21', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:28.916 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-21 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:28.962 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:28.963 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:29.196 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:29.189+0000 7f86cead50c0 1 bucket sync caught up with source: 2020-10-05T12:07:29.197 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000002.35.5, , ] 2020-10-05T12:07:29.197 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000002.35.5, , ] 2020-10-05T12:07:29.197 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:29.189+0000 7f86cead50c0 0 bucket checkpoint complete 2020-10-05T12:07:29.227 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-21', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:29.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-21', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:29.228 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-21 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:29.512 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:29.506+0000 7fea15f5f0c0 1 bucket sync caught up with source: 2020-10-05T12:07:29.513 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000002.35.5, , ] 2020-10-05T12:07:29.513 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000002.35.5, , ] 2020-10-05T12:07:29.513 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:29.506+0000 7fea15f5f0c0 0 bucket checkpoint complete 2020-10-05T12:07:29.550 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-21 zones={test-zone2, test-zone1} 2020-10-05T12:07:29.561 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:29.614 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:29.615 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:29.615 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:29.623 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:29.623 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:29.685 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:29.693 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:29.702 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:29.769 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-21 zones={test-zone2, test-zone1} 2020-10-05T12:07:29.769 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-21 zones={test-zone3, test-zone1} 2020-10-05T12:07:29.778 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:29.826 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:29.827 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:29.827 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:29.833 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:29.834 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:29.889 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:29.897 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:29.905 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:29.967 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-21 zones={test-zone3, test-zone1} 2020-10-05T12:07:29.968 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-21 zones={test-zone3, test-zone2} 2020-10-05T12:07:29.977 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:30.022 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:30.023 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:30.023 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:30.030 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:30.030 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:30.089 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:30.098 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:30.108 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:30.171 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-21 zones={test-zone3, test-zone2} 2020-10-05T12:07:30.172 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-22', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:30.172 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-22', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:30.173 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-22 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:30.220 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:30.220 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:30.452 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:30.446+0000 7f3af4d4a0c0 1 bucket sync caught up with source: 2020-10-05T12:07:30.452 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000002.15.5, , ] 2020-10-05T12:07:30.452 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000002.15.5, , ] 2020-10-05T12:07:30.452 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:30.446+0000 7f3af4d4a0c0 0 bucket checkpoint complete 2020-10-05T12:07:30.481 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-22', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:30.482 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-22', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:30.482 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-22 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:30.528 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:30.529 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:30.768 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:30.761+0000 7f2a252970c0 1 bucket sync caught up with source: 2020-10-05T12:07:30.769 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000002.15.5, , ] 2020-10-05T12:07:30.769 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000002.15.5, , ] 2020-10-05T12:07:30.769 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:30.761+0000 7f2a252970c0 0 bucket checkpoint complete 2020-10-05T12:07:30.796 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-22', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:30.796 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-22', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:30.797 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-22 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:30.844 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:30.845 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:31.093 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:31.086+0000 7ff4da3b40c0 1 bucket sync caught up with source: 2020-10-05T12:07:31.093 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000002.15.5, , ] 2020-10-05T12:07:31.093 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000002.15.5, , ] 2020-10-05T12:07:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:31.086+0000 7ff4da3b40c0 0 bucket checkpoint complete 2020-10-05T12:07:31.214 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-22', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:31.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-22', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:31.215 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-22 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:31.261 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:31.261 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:31.492 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:31.485+0000 7fb87a8f40c0 1 bucket sync caught up with source: 2020-10-05T12:07:31.493 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000003.22.11, , ] 2020-10-05T12:07:31.493 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000003.22.11, , ] 2020-10-05T12:07:31.493 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:31.485+0000 7fb87a8f40c0 0 bucket checkpoint complete 2020-10-05T12:07:31.526 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-22', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:31.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-22', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:31.527 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-22 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:31.615 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:31.616 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:31.842 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:31.837+0000 7fb4e98940c0 1 bucket sync caught up with source: 2020-10-05T12:07:31.843 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000003.22.11, , ] 2020-10-05T12:07:31.843 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000003.22.11, , ] 2020-10-05T12:07:31.843 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:31.837+0000 7fb4e98940c0 0 bucket checkpoint complete 2020-10-05T12:07:31.873 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-22', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:31.873 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-22', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:31.874 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-22 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:31.919 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:31.920 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:32.143 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:32.137+0000 7f1ed74220c0 1 bucket sync caught up with source: 2020-10-05T12:07:32.143 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000002.23.5, , ] 2020-10-05T12:07:32.143 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000002.23.5, , ] 2020-10-05T12:07:32.144 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:32.137+0000 7f1ed74220c0 0 bucket checkpoint complete 2020-10-05T12:07:32.168 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-22', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:32.169 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-22', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:32.169 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-22 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:32.442 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:32.438+0000 7f7963e670c0 1 bucket sync caught up with source: 2020-10-05T12:07:32.442 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000002.23.5, , ] 2020-10-05T12:07:32.443 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000002.23.5, , ] 2020-10-05T12:07:32.443 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:32.438+0000 7f7963e670c0 0 bucket checkpoint complete 2020-10-05T12:07:32.476 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-22 zones={test-zone2, test-zone1} 2020-10-05T12:07:32.487 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:32.534 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:32.535 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:32.535 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:32.543 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:32.544 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:32.602 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:32.609 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:32.620 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:32.685 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-22 zones={test-zone2, test-zone1} 2020-10-05T12:07:32.686 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-22 zones={test-zone3, test-zone1} 2020-10-05T12:07:32.694 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:32.742 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:32.743 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:32.743 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:32.750 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:32.750 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:32.804 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:32.813 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:32.821 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:32.888 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-22 zones={test-zone3, test-zone1} 2020-10-05T12:07:32.889 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-22 zones={test-zone3, test-zone2} 2020-10-05T12:07:32.899 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:32.946 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:32.947 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:32.947 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:32.955 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:32.955 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:33.014 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:33.022 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:33.033 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:33.105 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-22 zones={test-zone3, test-zone2} 2020-10-05T12:07:33.106 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-23', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:33.106 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-23', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:33.107 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-23 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:33.390 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:33.386+0000 7f998cd350c0 1 bucket sync caught up with source: 2020-10-05T12:07:33.391 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000002.27.5, , ] 2020-10-05T12:07:33.391 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000002.27.5, , ] 2020-10-05T12:07:33.391 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:33.386+0000 7f998cd350c0 0 bucket checkpoint complete 2020-10-05T12:07:33.424 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-23', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:33.424 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-23', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:33.425 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-23 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:33.471 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:33.471 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:33.707 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:33.701+0000 7f52b75710c0 1 bucket sync caught up with source: 2020-10-05T12:07:33.707 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000002.27.5, , ] 2020-10-05T12:07:33.708 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000002.27.5, , ] 2020-10-05T12:07:33.708 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:33.701+0000 7f52b75710c0 0 bucket checkpoint complete 2020-10-05T12:07:33.733 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-23', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:33.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-23', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:33.734 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-23 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:33.779 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:33.780 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:34.027 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:34.022+0000 7fca69a570c0 1 bucket sync caught up with source: 2020-10-05T12:07:34.028 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000002.27.5, , ] 2020-10-05T12:07:34.028 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000002.27.5, , ] 2020-10-05T12:07:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:34.022+0000 7fca69a570c0 0 bucket checkpoint complete 2020-10-05T12:07:34.148 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-23', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:34.148 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-23', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:34.149 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-23 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:34.193 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:34.194 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:34.426 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:34.421+0000 7f48669500c0 1 bucket sync caught up with source: 2020-10-05T12:07:34.427 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000002.51.5, , ] 2020-10-05T12:07:34.427 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000002.51.5, , ] 2020-10-05T12:07:34.427 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:34.421+0000 7f48669500c0 0 bucket checkpoint complete 2020-10-05T12:07:34.458 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-23', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:34.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-23', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:34.459 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-23 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:34.501 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:34.502 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:34.728 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:34.721+0000 7fa524ae50c0 1 bucket sync caught up with source: 2020-10-05T12:07:34.728 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000002.51.5, , ] 2020-10-05T12:07:34.729 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000002.51.5, , ] 2020-10-05T12:07:34.729 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:34.721+0000 7fa524ae50c0 0 bucket checkpoint complete 2020-10-05T12:07:34.758 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-23', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:34.759 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-23', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:34.759 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-23 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:34.845 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:34.846 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:35.081 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:35.073+0000 7f4e9daef0c0 1 bucket sync caught up with source: 2020-10-05T12:07:35.081 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000003.30.11, , ] 2020-10-05T12:07:35.081 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000003.30.11, , ] 2020-10-05T12:07:35.082 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:35.073+0000 7f4e9daef0c0 0 bucket checkpoint complete 2020-10-05T12:07:35.108 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-23', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:35.109 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-23', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:35.109 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-23 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:35.158 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:35.158 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:35.405 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:35.401+0000 7f600a5b10c0 1 bucket sync caught up with source: 2020-10-05T12:07:35.406 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000003.30.11, , ] 2020-10-05T12:07:35.406 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000003.30.11, , ] 2020-10-05T12:07:35.406 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:35.401+0000 7f600a5b10c0 0 bucket checkpoint complete 2020-10-05T12:07:35.434 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-23 zones={test-zone2, test-zone1} 2020-10-05T12:07:35.444 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:35.490 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:35.491 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:35.491 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:35.499 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:35.500 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:35.562 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:35.571 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:35.582 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:35.652 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-23 zones={test-zone2, test-zone1} 2020-10-05T12:07:35.652 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-23 zones={test-zone3, test-zone1} 2020-10-05T12:07:35.660 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:35.706 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:35.707 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:35.707 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:35.713 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:35.713 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:35.769 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:35.776 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:35.784 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:35.853 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-23 zones={test-zone3, test-zone1} 2020-10-05T12:07:35.853 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-23 zones={test-zone3, test-zone2} 2020-10-05T12:07:35.862 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:35.910 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:35.911 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:35.911 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:35.918 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:35.919 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:35.977 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:35.985 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:35.995 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:36.064 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-23 zones={test-zone3, test-zone2} 2020-10-05T12:07:36.065 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_delete_marker_full_sync ... ok 2020-10-05T12:07:36.066 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-24 2020-10-05T12:07:36.101 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-25 2020-10-05T12:07:36.158 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=dzadif-26 2020-10-05T12:07:36.325 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:36.326 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:36.327 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:36.362 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:36.363 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:36.572 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T12:07:36.605 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:07:36.606 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:36.606 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899656.318021_329.1", 2020-10-05T12:07:36.606 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:07:36.318021Z" 2020-10-05T12:07:36.606 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:36.606 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:36.607 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:36.607 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:02.535244Z" 2020-10-05T12:07:36.607 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:36.607 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:36.607 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:36.607 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:07:36.607 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:36.608 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:36.608 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:36.608 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:07:36.608 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:36.608 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:07:36.609 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T12:07:36.609 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:36.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:36.610 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:36.902 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:07:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:07:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:07:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:07:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:07:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:07:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:07:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:07:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899656.318021_329.1", 2020-10-05T12:07:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:07:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.318021Z", 2020-10-05T12:07:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:07:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:07:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:07:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:07:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:07:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:07:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:07:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:07:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:36.913 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:07:36.914 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T12:07:36.914 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T12:07:36.915 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:36.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:36.916 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:36.955 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:36.955 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:37.205 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:07:37.205 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:07:37.205 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:07:37.206 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:07:37.206 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:07:37.206 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:07:37.206 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:37.206 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:37.206 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:07:37.207 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:37.207 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:07:37.207 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:37.207 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:37.207 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899656.318021_329.1", 2020-10-05T12:07:37.207 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:37.208 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T12:07:37.208 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:37.208 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.318021Z", 2020-10-05T12:07:37.208 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:37.208 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:37.208 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:37.209 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:37.209 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:07:37.209 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:37.209 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:37.209 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:37.210 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:37.210 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:07:37.210 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:37.210 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:07:37.210 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:37.211 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:37.211 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:37.211 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:37.211 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:07:37.211 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:37.212 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:37.212 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:37.212 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:37.212 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:07:37.212 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:37.212 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:07:37.212 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:37.213 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:37.213 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:37.213 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:37.213 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:07:37.213 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:37.213 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:37.213 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:37.214 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:37.214 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:07:37.214 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:37.214 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:07:37.214 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:37.214 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:37.214 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:37.215 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:07:37.215 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:37.215 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:07:37.215 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T12:07:37.215 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T12:07:37.215 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:37.215 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:07:37.216 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T12:07:37.217 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T12:07:37.217 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:37.218 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:37.218 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:37.258 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:37.258 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:37.524 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:07:37.524 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:07:37.524 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:07:37.525 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:07:37.525 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:07:37.525 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:07:37.525 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:37.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:37.525 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:07:37.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:37.526 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:07:37.526 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:37.526 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:37.526 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899656.318021_329.1", 2020-10-05T12:07:37.526 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:37.526 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:07:37.527 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:37.527 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.318021Z", 2020-10-05T12:07:37.527 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:37.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:37.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:37.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:37.527 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:07:37.528 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:37.528 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:37.528 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:37.528 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:37.528 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:37.528 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:37.529 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:07:37.529 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:37.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:37.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:37.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:37.529 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:07:37.529 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:37.530 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:37.530 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:37.530 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:37.530 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:37.530 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:37.530 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:37.530 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:37.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:37.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:37.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:37.531 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:07:37.531 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:37.531 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:37.531 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:37.532 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:37.532 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:37.532 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:37.532 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:37.532 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:37.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:37.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:37.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:07:37.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:37.533 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:07:37.533 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:07:37.533 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:07:37.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:37.533 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:07:37.535 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T12:07:37.763 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-24', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:37.764 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-24', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:37.764 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-24 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:37.811 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:37.812 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:38.042 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:38.037+0000 7f827bfb50c0 1 bucket sync caught up with source: 2020-10-05T12:07:38.042 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000003.18.6, , ] 2020-10-05T12:07:38.042 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000003.18.6, , ] 2020-10-05T12:07:38.042 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:38.037+0000 7f827bfb50c0 0 bucket checkpoint complete 2020-10-05T12:07:38.070 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-24', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:38.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-24', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:38.071 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-24 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:38.117 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:38.118 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:38.324 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:38.316+0000 7f741d9e60c0 1 bucket sync caught up with source: 2020-10-05T12:07:38.324 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000003.18.6, , ] 2020-10-05T12:07:38.324 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000003.18.6, , ] 2020-10-05T12:07:38.325 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:38.316+0000 7f741d9e60c0 0 bucket checkpoint complete 2020-10-05T12:07:38.350 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-24', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:38.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-24', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:38.351 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-24 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:38.397 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:38.397 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:38.622 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:38.617+0000 7f9d3d86f0c0 1 bucket sync caught up with source: 2020-10-05T12:07:38.623 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000003.18.6, , ] 2020-10-05T12:07:38.623 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000003.18.6, , ] 2020-10-05T12:07:38.623 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:38.617+0000 7f9d3d86f0c0 0 bucket checkpoint complete 2020-10-05T12:07:38.662 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-24', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:38.663 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-24', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:38.663 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-24 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:38.714 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:38.714 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:38.968 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:38.960+0000 7f90301150c0 1 bucket sync caught up with source: 2020-10-05T12:07:38.968 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.25.12, , ] 2020-10-05T12:07:38.968 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000001.25.12, , ] 2020-10-05T12:07:38.968 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:38.960+0000 7f90301150c0 0 bucket checkpoint complete 2020-10-05T12:07:38.998 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-24', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:38.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-24', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:38.999 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-24 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:39.043 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:39.043 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:39.275 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:39.268+0000 7fd85e1d20c0 1 bucket sync caught up with source: 2020-10-05T12:07:39.275 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.25.12, , ] 2020-10-05T12:07:39.275 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000001.25.12, , ] 2020-10-05T12:07:39.275 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:39.268+0000 7fd85e1d20c0 0 bucket checkpoint complete 2020-10-05T12:07:39.304 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-24', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:39.305 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-24', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:39.305 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-24 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:39.390 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:39.391 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:39.633 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:39.628+0000 7fe2939300c0 1 bucket sync caught up with source: 2020-10-05T12:07:39.633 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.20.12, , ] 2020-10-05T12:07:39.633 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000001.20.12, , ] 2020-10-05T12:07:39.634 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:39.628+0000 7fe2939300c0 0 bucket checkpoint complete 2020-10-05T12:07:39.658 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-24', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:39.658 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-24', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:39.659 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-24 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:39.712 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:39.962 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:39.957+0000 7fcd07ef70c0 1 bucket sync caught up with source: 2020-10-05T12:07:39.963 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000001.20.12, , ] 2020-10-05T12:07:39.963 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000001.20.12, , ] 2020-10-05T12:07:39.963 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:39.957+0000 7fcd07ef70c0 0 bucket checkpoint complete 2020-10-05T12:07:39.994 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-24 zones={test-zone2, test-zone1} 2020-10-05T12:07:40.006 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:40.054 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:40.055 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:40.062 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:40.121 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:40.126 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-24 zones={test-zone2, test-zone1} 2020-10-05T12:07:40.127 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-24 zones={test-zone3, test-zone1} 2020-10-05T12:07:40.135 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:40.182 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:40.183 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:40.190 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:40.245 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:40.250 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-24 zones={test-zone3, test-zone1} 2020-10-05T12:07:40.251 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-24 zones={test-zone3, test-zone2} 2020-10-05T12:07:40.261 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:40.311 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:40.312 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:40.318 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:40.374 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:40.379 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-24 zones={test-zone3, test-zone2} 2020-10-05T12:07:40.380 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-25', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:40.380 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-25', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:40.381 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-25 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:40.428 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:40.428 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:40.668 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:40.661+0000 7f185fdc60c0 1 bucket sync caught up with source: 2020-10-05T12:07:40.669 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000001.9.12, , ] 2020-10-05T12:07:40.669 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000001.9.12, , ] 2020-10-05T12:07:40.669 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:40.661+0000 7f185fdc60c0 0 bucket checkpoint complete 2020-10-05T12:07:40.700 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-25', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:40.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-25', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:40.701 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-25 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:40.750 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:40.750 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:40.979 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:40.976+0000 7fde1adba0c0 1 bucket sync caught up with source: 2020-10-05T12:07:40.980 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.9.12, , ] 2020-10-05T12:07:40.980 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000001.9.12, , ] 2020-10-05T12:07:40.980 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:40.976+0000 7fde1adba0c0 0 bucket checkpoint complete 2020-10-05T12:07:41.007 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-25', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:41.008 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-25', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:41.008 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-25 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:41.053 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:41.285+0000 7f3af0afd0c0 1 bucket sync caught up with source: 2020-10-05T12:07:41.293 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000001.9.12, , ] 2020-10-05T12:07:41.294 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000001.9.12, , ] 2020-10-05T12:07:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:41.285+0000 7f3af0afd0c0 0 bucket checkpoint complete 2020-10-05T12:07:41.421 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-25', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:41.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-25', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:41.422 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-25 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:41.470 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:41.470 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:41.707 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:41.704+0000 7f01a35600c0 1 bucket sync caught up with source: 2020-10-05T12:07:41.707 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000003.26.6, , ] 2020-10-05T12:07:41.708 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000003.26.6, , ] 2020-10-05T12:07:41.708 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:41.704+0000 7f01a35600c0 0 bucket checkpoint complete 2020-10-05T12:07:41.737 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-25', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:41.737 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-25', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:41.738 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-25 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:41.782 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:41.782 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:42.017 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:42.012+0000 7f153e6e10c0 1 bucket sync caught up with source: 2020-10-05T12:07:42.017 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000003.26.6, , ] 2020-10-05T12:07:42.018 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000003.26.6, , ] 2020-10-05T12:07:42.018 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:42.012+0000 7f153e6e10c0 0 bucket checkpoint complete 2020-10-05T12:07:42.049 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-25', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:42.049 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-25', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:42.050 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-25 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:42.094 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:42.095 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:42.320 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:42.316+0000 7fb1c71000c0 1 bucket sync caught up with source: 2020-10-05T12:07:42.320 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.15.12, , ] 2020-10-05T12:07:42.321 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000001.15.12, , ] 2020-10-05T12:07:42.321 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:42.316+0000 7fb1c71000c0 0 bucket checkpoint complete 2020-10-05T12:07:42.347 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-25', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:42.348 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-25', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:42.348 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-25 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:42.637+0000 7ff5b12d20c0 1 bucket sync caught up with source: 2020-10-05T12:07:42.643 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000001.15.12, , ] 2020-10-05T12:07:42.644 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000001.15.12, , ] 2020-10-05T12:07:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:42.637+0000 7ff5b12d20c0 0 bucket checkpoint complete 2020-10-05T12:07:42.675 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-25 zones={test-zone2, test-zone1} 2020-10-05T12:07:42.683 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:42.730 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:42.731 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:42.738 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:42.792 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:42.798 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-25 zones={test-zone2, test-zone1} 2020-10-05T12:07:42.798 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-25 zones={test-zone3, test-zone1} 2020-10-05T12:07:42.806 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:42.854 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:42.855 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:42.862 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:42.917 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:42.923 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-25 zones={test-zone3, test-zone1} 2020-10-05T12:07:42.923 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-25 zones={test-zone3, test-zone2} 2020-10-05T12:07:42.933 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:42.978 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:42.979 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:42.987 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:43.045 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:43.051 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-25 zones={test-zone3, test-zone2} 2020-10-05T12:07:43.051 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-26', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:43.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-26', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:43.052 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-26 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:43.098 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:43.098 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:43.334 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:43.329+0000 7f061360b0c0 1 bucket sync caught up with source: 2020-10-05T12:07:43.334 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000001.40.12, , ] 2020-10-05T12:07:43.334 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000001.40.12, , ] 2020-10-05T12:07:43.334 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:43.329+0000 7f061360b0c0 0 bucket checkpoint complete 2020-10-05T12:07:43.363 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-26', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:43.364 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-26', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:43.364 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-26 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:43.405 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:43.406 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:43.634 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:43.632+0000 7fe5e27350c0 1 bucket sync caught up with source: 2020-10-05T12:07:43.635 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.40.12, , ] 2020-10-05T12:07:43.635 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000001.40.12, , ] 2020-10-05T12:07:43.635 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:43.632+0000 7fe5e27350c0 0 bucket checkpoint complete 2020-10-05T12:07:43.660 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-26', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:43.661 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-26', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:43.662 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-26 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:43.938 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:43.933+0000 7f2a1a5720c0 1 bucket sync caught up with source: 2020-10-05T12:07:43.938 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000001.40.12, , ] 2020-10-05T12:07:43.939 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000001.40.12, , ] 2020-10-05T12:07:43.939 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:43.933+0000 7f2a1a5720c0 0 bucket checkpoint complete 2020-10-05T12:07:43.974 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-26', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:43.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-26', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:43.975 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-26 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:44.021 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:44.022 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:44.253 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:44.248+0000 7f9b5f8400c0 1 bucket sync caught up with source: 2020-10-05T12:07:44.254 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.64.12, , ] 2020-10-05T12:07:44.254 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000001.64.12, , ] 2020-10-05T12:07:44.255 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:44.252+0000 7f9b5f8400c0 0 bucket checkpoint complete 2020-10-05T12:07:44.287 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-26', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:44.288 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-26', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:44.288 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-26 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:44.332 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:44.332 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:44.572 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:44.568+0000 7fd7812680c0 1 bucket sync caught up with source: 2020-10-05T12:07:44.572 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000001.64.12, , ] 2020-10-05T12:07:44.572 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000001.64.12, , ] 2020-10-05T12:07:44.572 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:44.568+0000 7fd7812680c0 0 bucket checkpoint complete 2020-10-05T12:07:44.600 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-26', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:44.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-26', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:44.602 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket dzadif-26 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:44.688 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:44.688 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:44.926 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:44.924+0000 7f191dac10c0 1 bucket sync caught up with source: 2020-10-05T12:07:44.926 INFO:teuthology.orchestra.run.smithi158.stderr: local status: [, , , , , , , , 00000000003.61.6, , ] 2020-10-05T12:07:44.927 INFO:teuthology.orchestra.run.smithi158.stderr: remote markers: [, , , , , , , , 00000000003.61.6, , ] 2020-10-05T12:07:44.927 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:07:44.924+0000 7f191dac10c0 0 bucket checkpoint complete 2020-10-05T12:07:44.955 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-26', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:44.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'dzadif-26', '--source-zone', 'test-zone3', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2020-10-05T12:07:44.956 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket dzadif-26 --source-zone test-zone3 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2020-10-05T12:07:45.001 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:45.002 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:45.242 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:45.237+0000 7f4a7d32a0c0 1 bucket sync caught up with source: 2020-10-05T12:07:45.243 INFO:teuthology.orchestra.run.smithi081.stderr: local status: [, , , , , , , , 00000000003.61.6, , ] 2020-10-05T12:07:45.243 INFO:teuthology.orchestra.run.smithi081.stderr: remote markers: [, , , , , , , , 00000000003.61.6, , ] 2020-10-05T12:07:45.243 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:45.237+0000 7f4a7d32a0c0 0 bucket checkpoint complete 2020-10-05T12:07:45.274 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-26 zones={test-zone2, test-zone1} 2020-10-05T12:07:45.286 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:45.334 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:45.335 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:45.341 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:45.397 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:45.403 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-26 zones={test-zone2, test-zone1} 2020-10-05T12:07:45.403 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-26 zones={test-zone3, test-zone1} 2020-10-05T12:07:45.413 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:45.462 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:45.463 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:45.470 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:45.529 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:45.534 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-26 zones={test-zone3, test-zone1} 2020-10-05T12:07:45.535 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-26 zones={test-zone3, test-zone2} 2020-10-05T12:07:45.546 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:07:45.594 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:45.595 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:07:45.602 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2020-10-05T12:07:45.659 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2020-10-05T12:07:45.665 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-26 zones={test-zone3, test-zone2} 2020-10-05T12:07:45.665 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_suspended_delete_marker_full_sync ... ok 2020-10-05T12:07:45.666 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-27 2020-10-05T12:07:45.702 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-28 2020-10-05T12:07:45.765 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=dzadif-29 2020-10-05T12:07:46.022 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_versioning ... ok 2020-10-05T12:07:46.023 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-30 2020-10-05T12:07:46.065 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-31 2020-10-05T12:07:46.124 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=dzadif-32 2020-10-05T12:07:46.394 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_acl ... ok 2020-10-05T12:07:46.395 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-33 2020-10-05T12:07:46.428 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-34 2020-10-05T12:07:46.482 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=dzadif-35 2020-10-05T12:07:48.734 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_cors ... ok 2020-10-05T12:07:48.735 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-36 2020-10-05T12:07:48.772 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-37 2020-10-05T12:07:48.846 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=dzadif-38 2020-10-05T12:07:48.906 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:48.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:48.908 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:48.940 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:48.941 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:49.152 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T12:07:49.185 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:07:49.185 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:49.186 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899668.888419_402.1", 2020-10-05T12:07:49.186 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:07:48.888419Z" 2020-10-05T12:07:49.186 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:49.186 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:49.187 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:49.187 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:02.535244Z" 2020-10-05T12:07:49.187 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:49.187 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:49.188 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:49.188 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:07:49.188 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:49.188 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:49.189 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:49.189 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:07:49.189 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:49.189 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:07:49.191 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T12:07:49.191 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:49.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:49.193 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:49.231 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:49.232 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:49.479 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:07:49.479 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:07:49.480 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:07:49.480 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:07:49.480 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:07:49.480 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:07:49.480 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:49.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:49.481 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:07:49.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:49.481 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:07:49.481 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:49.481 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:49.481 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899668.888419_402.1", 2020-10-05T12:07:49.481 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:49.482 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:07:49.482 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:49.482 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.888419Z", 2020-10-05T12:07:49.482 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:49.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:49.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:49.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:49.483 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:07:49.483 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:49.483 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:49.483 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:49.483 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:49.483 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:49.483 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:49.484 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:07:49.484 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:49.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:49.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:49.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:49.484 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:07:49.484 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:49.485 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:49.485 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:49.485 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:49.485 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:49.485 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:49.485 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:49.485 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:49.485 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:49.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:49.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:49.486 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:07:49.486 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:49.486 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:49.486 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:49.486 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:49.487 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:49.487 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:49.487 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:49.487 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:49.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:49.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:49.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:07:49.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:49.488 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:07:49.488 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:07:49.488 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:07:49.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:49.488 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:07:49.489 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T12:07:49.490 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T12:07:49.490 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:49.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:49.491 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:49.533 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:49.534 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:49.779 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:07:49.780 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:07:49.780 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:07:49.780 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:07:49.780 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:07:49.780 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:07:49.780 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:49.781 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:49.781 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:07:49.781 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:49.781 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:07:49.781 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:49.781 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:49.781 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899668.888419_402.1", 2020-10-05T12:07:49.782 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:49.782 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T12:07:49.782 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:49.782 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.888419Z", 2020-10-05T12:07:49.782 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:49.782 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:49.782 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:49.783 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:49.783 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:07:49.783 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:49.783 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:49.783 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:49.783 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:49.783 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:07:49.784 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:49.784 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:07:49.784 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:49.784 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:49.784 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:49.784 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:49.784 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:07:49.785 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:49.785 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:49.785 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:49.785 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:49.785 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:07:49.785 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:49.785 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:07:49.786 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:49.786 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:49.786 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:49.786 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:49.786 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:07:49.786 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:49.786 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:49.787 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:49.787 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:49.787 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:07:49.787 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:49.787 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:07:49.787 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:49.787 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:49.787 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:49.788 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:07:49.788 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:49.788 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:07:49.788 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T12:07:49.788 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T12:07:49.788 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:49.788 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:07:49.789 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T12:07:49.790 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T12:07:49.790 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:49.791 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:49.791 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:49.832 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:50.104 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:07:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:07:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:07:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:07:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:07:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:07:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:07:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:07:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899668.888419_402.1", 2020-10-05T12:07:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:07:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.888419Z", 2020-10-05T12:07:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:07:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:07:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:07:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:07:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:07:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:07:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:07:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:07:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:50.113 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:07:50.114 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T12:07:50.468 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_delete_notempty ... ok 2020-10-05T12:07:50.469 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-39 2020-10-05T12:07:50.498 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-40 2020-10-05T12:07:50.579 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=dzadif-41 2020-10-05T12:07:50.665 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:50.666 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:50.667 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:50.708 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:50.708 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:50.888 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=eb044115-4632-4a42-8790-5052d87ef1c6 2020-10-05T12:07:50.922 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:07:50.923 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:50.923 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899670.607428_415.1", 2020-10-05T12:07:50.923 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:07:50.607428Z" 2020-10-05T12:07:50.924 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:50.924 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:50.924 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:50.924 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T11:59:02.535244Z" 2020-10-05T12:07:50.925 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:50.925 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:50.925 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:50.926 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:07:50.926 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:50.926 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:50.927 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:50.927 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:07:50.927 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:50.927 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:07:50.929 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T12:07:50.929 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:50.930 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:50.930 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:50.971 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:50.972 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:51.227 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:07:51.227 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:07:51.227 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:07:51.227 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:07:51.227 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:07:51.228 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:07:51.228 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:51.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:51.228 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:07:51.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:51.228 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:07:51.228 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:51.229 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:51.229 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899670.607428_415.1", 2020-10-05T12:07:51.229 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:51.229 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:07:51.229 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:51.229 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.607428Z", 2020-10-05T12:07:51.230 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:51.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:51.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:51.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:51.230 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:07:51.230 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:51.230 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:51.231 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:51.231 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:51.231 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:51.231 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:51.231 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:07:51.232 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:51.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:51.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:51.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:51.232 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:07:51.232 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:51.233 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:51.233 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:51.233 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:51.233 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:51.233 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:51.233 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:51.233 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:51.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:51.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:51.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:51.234 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:07:51.234 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:51.234 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:51.235 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:51.235 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:51.235 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:51.235 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:51.235 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:51.235 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:51.236 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:51.236 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:51.236 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:07:51.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:51.236 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:07:51.236 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:07:51.236 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:07:51.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:51.237 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:07:51.238 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T12:07:51.238 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T12:07:51.239 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:51.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:51.240 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:51.280 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:51.281 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:51.515 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:07:51.516 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:07:51.516 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:07:51.516 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:07:51.517 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:07:51.517 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:07:51.517 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:51.517 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:51.518 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:07:51.518 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:51.518 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:07:51.518 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:51.519 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:51.519 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899670.607428_415.1", 2020-10-05T12:07:51.519 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:51.520 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T12:07:51.520 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:51.520 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.607428Z", 2020-10-05T12:07:51.520 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:51.521 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:51.521 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:51.521 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:51.522 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:07:51.522 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:51.522 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:51.522 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:51.523 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:51.523 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:07:51.523 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:51.523 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:07:51.524 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:51.524 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:51.524 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:51.524 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:51.525 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:07:51.525 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:51.525 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:51.525 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:51.525 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:51.526 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:07:51.526 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:51.526 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:07:51.526 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:51.527 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:51.527 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:51.527 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:07:51.527 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:07:51.528 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:07:51.528 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:07:51.528 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:07:51.528 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:07:51.529 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:07:51.529 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:07:51.529 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:07:51.530 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:07:51.530 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:51.530 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:51.531 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:07:51.531 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:07:51.531 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:07:51.531 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T12:07:51.532 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T12:07:51.532 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:07:51.532 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:07:51.534 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T12:07:51.535 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T12:07:51.535 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:51.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:07:51.537 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:07:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:51.849 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:07:51.850 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:07:51.850 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:07:51.850 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:07:51.850 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:07:51.850 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:07:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:07:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:07:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899670.607428_415.1", 2020-10-05T12:07:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:07:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.607428Z", 2020-10-05T12:07:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:07:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:07:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:07:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:07:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:07:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:07:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:07:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:07:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:07:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:07:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:07:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:07:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:07:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:07:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:07:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:07:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:51.858 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:07:51.859 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T12:07:51.861 DEBUG:tasks.rgw.c1.client.1:waiting for process to exit 2020-10-05T12:07:51.862 INFO:teuthology.orchestra.run:waiting for 300 2020-10-05T12:07:51.863 INFO:tasks.rgw.c1.client.1.smithi158.stdout:2020-10-05T12:07:51.860+0000 7fdf537fe700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 16917) UID: 0 2020-10-05T12:07:51.863 INFO:tasks.rgw.c1.client.1.smithi158.stdout:2020-10-05T12:07:51.860+0000 7fdf77237100 -1 shutting down 2020-10-05T12:07:52.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.1 is failed for ~0s 2020-10-05T12:07:57.964 INFO:tasks.rgw.c1.client.1:Stopped 2020-10-05T12:07:57.965 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:07:57.966 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:07:57.967 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c2 --debug-rgw 0 --debug-ms 0 2020-10-05T12:07:58.008 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:58.009 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:58.029+0000 7fede49db0c0 0 NOTICE: overriding master zone: 35a06950-5b24-42ca-86ff-3dc913eb1ccc 2020-10-05T12:07:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:58.033+0000 7fede49db0c0 0 failed reading obj info from .rgw.root:zone_info.35a06950-5b24-42ca-86ff-3dc913eb1ccc: (2) No such file or directory 2020-10-05T12:07:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:58.033+0000 7fede49db0c0 0 WARNING: could not read zone params for zone id=35a06950-5b24-42ca-86ff-3dc913eb1ccc name=test-zone1 2020-10-05T12:07:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:58.033+0000 7fede49db0c0 0 failed reading obj info from .rgw.root:zone_info.7a89cb1a-d0ea-4e52-a3d1-f1de1f9f3d6e: (2) No such file or directory 2020-10-05T12:07:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2020-10-05T12:07:58.033+0000 7fede49db0c0 0 WARNING: could not read zone params for zone id=7a89cb1a-d0ea-4e52-a3d1-f1de1f9f3d6e name=test-zone3 2020-10-05T12:07:58.050 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:07:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T12:07:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone2", 2020-10-05T12:07:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "domain_root": "test-zone2.rgw.meta:root", 2020-10-05T12:07:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "control_pool": "test-zone2.rgw.control", 2020-10-05T12:07:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "gc_pool": "test-zone2.rgw.log:gc", 2020-10-05T12:07:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "lc_pool": "test-zone2.rgw.log:lc", 2020-10-05T12:07:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "log_pool": "test-zone2.rgw.log", 2020-10-05T12:07:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "intent_log_pool": "test-zone2.rgw.log:intent", 2020-10-05T12:07:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "usage_log_pool": "test-zone2.rgw.log:usage", 2020-10-05T12:07:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "roles_pool": "test-zone2.rgw.meta:roles", 2020-10-05T12:07:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "reshard_pool": "test-zone2.rgw.log:reshard", 2020-10-05T12:07:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "user_keys_pool": "test-zone2.rgw.meta:users.keys", 2020-10-05T12:07:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: "user_email_pool": "test-zone2.rgw.meta:users.email", 2020-10-05T12:07:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: "user_swift_pool": "test-zone2.rgw.meta:users.swift", 2020-10-05T12:07:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: "user_uid_pool": "test-zone2.rgw.meta:users.uid", 2020-10-05T12:07:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: "otp_pool": "test-zone2.rgw.otp", 2020-10-05T12:07:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: "system_key": { 2020-10-05T12:07:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: "access_key": "VXETEEL80ZIAZNTY", 2020-10-05T12:07:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: "secret_key": "VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv" 2020-10-05T12:07:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: "placement_pools": [ 2020-10-05T12:07:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "default-placement", 2020-10-05T12:07:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:07:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: "index_pool": "test-zone2.rgw.buckets.index", 2020-10-05T12:07:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_classes": { 2020-10-05T12:07:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: "STANDARD": { 2020-10-05T12:07:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: "data_pool": "test-zone2.rgw.buckets.data", 2020-10-05T12:07:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: "compression_type": "random" 2020-10-05T12:07:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: "data_extra_pool": "test-zone2.rgw.buckets.non-ec", 2020-10-05T12:07:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: "index_type": 0 2020-10-05T12:07:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T12:07:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T12:07:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: "notif_pool": "test-zone2.rgw.log:notif" 2020-10-05T12:07:58.059 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:07:58.060 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:07:58.060 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:07:58.061 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2020-10-05T12:07:58.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.1 has been restored 2020-10-05T12:07:58.138 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:07:58.138 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:07:58.429 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:07:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "de1ec5d2-2844-47c8-bc1d-b6fc2f043687", 2020-10-05T12:07:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2020-10-05T12:07:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: "predecessor_uuid": "eb044115-4632-4a42-8790-5052d87ef1c6", 2020-10-05T12:07:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": [ 2020-10-05T12:07:58.430 INFO:teuthology.orchestra.run.smithi081.stdout: "1_1601899670.607428_415.1", 2020-10-05T12:07:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: "1_1601899142.535244_102.1", 2020-10-05T12:07:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2020-10-05T12:07:58.431 INFO:teuthology.orchestra.run.smithi081.stdout: "" 2020-10-05T12:07:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T12:07:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: "period_map": { 2020-10-05T12:07:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "de1ec5d2-2844-47c8-bc1d-b6fc2f043687", 2020-10-05T12:07:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: "zonegroups": [ 2020-10-05T12:07:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:58.432 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "test-zonegroup", 2020-10-05T12:07:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zonegroup", 2020-10-05T12:07:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: "api_name": "", 2020-10-05T12:07:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: "is_master": "true", 2020-10-05T12:07:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: "endpoints": [ 2020-10-05T12:07:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: "http://smithi158.front.sepia.ceph.com:8000" 2020-10-05T12:07:58.433 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T12:07:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "hostnames": [], 2020-10-05T12:07:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "hostnames_s3website": [], 2020-10-05T12:07:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "master_zone": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T12:07:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "zones": [ 2020-10-05T12:07:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T12:07:58.434 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone1", 2020-10-05T12:07:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: "endpoints": [ 2020-10-05T12:07:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: "http://smithi158.front.sepia.ceph.com:8000" 2020-10-05T12:07:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T12:07:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: "log_meta": "false", 2020-10-05T12:07:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: "log_data": "true", 2020-10-05T12:07:58.435 INFO:teuthology.orchestra.run.smithi081.stdout: "bucket_index_max_shards": 11, 2020-10-05T12:07:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: "read_only": "false", 2020-10-05T12:07:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_type": "", 2020-10-05T12:07:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from_all": "true", 2020-10-05T12:07:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from": [], 2020-10-05T12:07:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_zone": "" 2020-10-05T12:07:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "7a89cb1a-d0ea-4e52-a3d1-f1de1f9f3d6e", 2020-10-05T12:07:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone3", 2020-10-05T12:07:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "endpoints": [ 2020-10-05T12:07:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "http://smithi158.front.sepia.ceph.com:8001" 2020-10-05T12:07:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T12:07:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "log_meta": "false", 2020-10-05T12:07:58.437 INFO:teuthology.orchestra.run.smithi081.stdout: "log_data": "true", 2020-10-05T12:07:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: "bucket_index_max_shards": 11, 2020-10-05T12:07:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: "read_only": "false", 2020-10-05T12:07:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_type": "", 2020-10-05T12:07:58.438 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from_all": "true", 2020-10-05T12:07:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from": [], 2020-10-05T12:07:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_zone": "" 2020-10-05T12:07:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:58.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T12:07:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone2", 2020-10-05T12:07:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: "endpoints": [ 2020-10-05T12:07:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: "http://smithi081.front.sepia.ceph.com:8000" 2020-10-05T12:07:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T12:07:58.440 INFO:teuthology.orchestra.run.smithi081.stdout: "log_meta": "false", 2020-10-05T12:07:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "log_data": "true", 2020-10-05T12:07:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "bucket_index_max_shards": 11, 2020-10-05T12:07:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "read_only": "false", 2020-10-05T12:07:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_type": "", 2020-10-05T12:07:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from_all": "true", 2020-10-05T12:07:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from": [], 2020-10-05T12:07:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_zone": "" 2020-10-05T12:07:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "d4a952c4-a878-4b40-9af3-dc61e86204eb", 2020-10-05T12:07:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test-zone4", 2020-10-05T12:07:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "endpoints": [ 2020-10-05T12:07:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "http://smithi081.front.sepia.ceph.com:8001" 2020-10-05T12:07:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T12:07:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "log_meta": "false", 2020-10-05T12:07:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "log_data": "true", 2020-10-05T12:07:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "bucket_index_max_shards": 11, 2020-10-05T12:07:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "read_only": "false", 2020-10-05T12:07:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_type": "pubsub", 2020-10-05T12:07:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from_all": "false", 2020-10-05T12:07:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_from": [ 2020-10-05T12:07:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "test-zone1" 2020-10-05T12:07:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T12:07:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_zone": "" 2020-10-05T12:07:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T12:07:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "placement_targets": [ 2020-10-05T12:07:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default-placement", 2020-10-05T12:07:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2020-10-05T12:07:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_classes": [ 2020-10-05T12:07:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "STANDARD" 2020-10-05T12:07:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:07:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T12:07:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "default_placement": "default-placement", 2020-10-05T12:07:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T12:07:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_policy": { 2020-10-05T12:07:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "groups": [] 2020-10-05T12:07:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2020-10-05T12:07:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: "short_zone_ids": [ 2020-10-05T12:07:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:58.460 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T12:07:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 3324834999 2020-10-05T12:07:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "7a89cb1a-d0ea-4e52-a3d1-f1de1f9f3d6e", 2020-10-05T12:07:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 2396638170 2020-10-05T12:07:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:58.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T12:07:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 4213498805 2020-10-05T12:07:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:07:58.462 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "d4a952c4-a878-4b40-9af3-dc61e86204eb", 2020-10-05T12:07:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 3646836627 2020-10-05T12:07:58.463 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:07:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: "master_zonegroup": "test-zonegroup", 2020-10-05T12:07:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: "master_zone": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T12:07:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: "period_config": { 2020-10-05T12:07:58.464 INFO:teuthology.orchestra.run.smithi081.stdout: "bucket_quota": { 2020-10-05T12:07:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": false, 2020-10-05T12:07:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "check_on_raw": false, 2020-10-05T12:07:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "max_size": -1, 2020-10-05T12:07:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "max_size_kb": 0, 2020-10-05T12:07:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "max_objects": -1 2020-10-05T12:07:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:58.465 INFO:teuthology.orchestra.run.smithi081.stdout: "user_quota": { 2020-10-05T12:07:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": false, 2020-10-05T12:07:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: "check_on_raw": false, 2020-10-05T12:07:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: "max_size": -1, 2020-10-05T12:07:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: "max_size_kb": 0, 2020-10-05T12:07:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: "max_objects": -1 2020-10-05T12:07:58.466 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:07:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:07:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T12:07:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_name": "test-realm", 2020-10-05T12:07:58.467 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 3 2020-10-05T12:07:58.467 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:07:58.468 INFO:rgw_multi.tests:Set master zone=test-zone2, waiting 60s for reconfiguration.. 2020-10-05T12:08:58.470 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-42 2020-10-05T12:08:58.562 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-43 2020-10-05T12:08:58.606 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:08:58.607 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:08:58.607 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:08:58.650 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:08:58.651 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:08:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:No --period given, using current period=de1ec5d2-2844-47c8-bc1d-b6fc2f043687 2020-10-05T12:08:58.896 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2020-10-05T12:08:58.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:08:58.897 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899738.601888_62.1", 2020-10-05T12:08:58.897 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:08:58.601888Z" 2020-10-05T12:08:58.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:08:58.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:08:58.897 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:08:58.897 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "0.000000" 2020-10-05T12:08:58.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:08:58.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:08:58.898 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:08:58.898 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "0.000000" 2020-10-05T12:08:58.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:08:58.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:08:58.899 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:08:58.899 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "0.000000" 2020-10-05T12:08:58.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:08:58.899 INFO:teuthology.orchestra.run.smithi081.stdout:] 2020-10-05T12:08:58.900 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone1 2020-10-05T12:08:58.901 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:08:58.901 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:08:58.902 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:08:58.943 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:08:58.944 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:08:59.206 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:08:59.207 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:08:59.207 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:08:59.207 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:08:59.207 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:08:59.207 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "de1ec5d2-2844-47c8-bc1d-b6fc2f043687", 2020-10-05T12:08:59.207 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 3 2020-10-05T12:08:59.207 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.208 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:08:59.208 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.208 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:08:59.208 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:08:59.208 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:08:59.208 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899738.601888_62.1", 2020-10-05T12:08:59.208 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:08:59.209 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 80, 2020-10-05T12:08:59.209 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:08:59.209 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.601888Z", 2020-10-05T12:08:59.209 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 3 2020-10-05T12:08:59.209 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.209 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.209 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.210 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:08:59.210 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:08:59.210 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:08:59.210 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:08:59.210 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:08:59.211 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:08:59.211 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:08:59.211 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:08:59.211 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 3 2020-10-05T12:08:59.211 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.211 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.211 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.212 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:08:59.212 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:08:59.212 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:08:59.212 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:08:59.212 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:08:59.212 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:08:59.212 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:08:59.213 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:08:59.213 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 3 2020-10-05T12:08:59.213 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.213 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.213 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.213 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:08:59.213 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:08:59.214 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:08:59.220 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:08:59.220 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:08:59.220 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:08:59.221 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:08:59.221 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:08:59.221 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 3 2020-10-05T12:08:59.222 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.222 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.222 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:08:59.222 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.223 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:08:59.223 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 80, 2020-10-05T12:08:59.223 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 80 2020-10-05T12:08:59.224 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.224 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:08:59.227 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone1 2020-10-05T12:08:59.228 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:08:59.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:08:59.229 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone modify --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T12:08:59.325 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:08:59.326 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:08:59.348 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:08:59.343+0000 7f21371dd0c0 0 NOTICE: overriding master zone: bdf35e5b-c653-4ef8-994d-7961e459db28 2020-10-05T12:08:59.353 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:08:59.347+0000 7f21371dd0c0 0 failed reading obj info from .rgw.root:zone_info.bdf35e5b-c653-4ef8-994d-7961e459db28: (2) No such file or directory 2020-10-05T12:08:59.354 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:08:59.347+0000 7f21371dd0c0 0 WARNING: could not read zone params for zone id=bdf35e5b-c653-4ef8-994d-7961e459db28 name=test-zone2 2020-10-05T12:08:59.354 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:08:59.351+0000 7f21371dd0c0 0 failed reading obj info from .rgw.root:zone_info.d4a952c4-a878-4b40-9af3-dc61e86204eb: (2) No such file or directory 2020-10-05T12:08:59.354 INFO:teuthology.orchestra.run.smithi158.stderr:2020-10-05T12:08:59.351+0000 7f21371dd0c0 0 WARNING: could not read zone params for zone id=d4a952c4-a878-4b40-9af3-dc61e86204eb name=test-zone4 2020-10-05T12:08:59.365 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:08:59.366 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T12:08:59.367 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zone1", 2020-10-05T12:08:59.367 INFO:teuthology.orchestra.run.smithi158.stdout: "domain_root": "test-zone1.rgw.meta:root", 2020-10-05T12:08:59.368 INFO:teuthology.orchestra.run.smithi158.stdout: "control_pool": "test-zone1.rgw.control", 2020-10-05T12:08:59.370 INFO:teuthology.orchestra.run.smithi158.stdout: "gc_pool": "test-zone1.rgw.log:gc", 2020-10-05T12:08:59.370 INFO:teuthology.orchestra.run.smithi158.stdout: "lc_pool": "test-zone1.rgw.log:lc", 2020-10-05T12:08:59.371 INFO:teuthology.orchestra.run.smithi158.stdout: "log_pool": "test-zone1.rgw.log", 2020-10-05T12:08:59.371 INFO:teuthology.orchestra.run.smithi158.stdout: "intent_log_pool": "test-zone1.rgw.log:intent", 2020-10-05T12:08:59.371 INFO:teuthology.orchestra.run.smithi158.stdout: "usage_log_pool": "test-zone1.rgw.log:usage", 2020-10-05T12:08:59.372 INFO:teuthology.orchestra.run.smithi158.stdout: "roles_pool": "test-zone1.rgw.meta:roles", 2020-10-05T12:08:59.372 INFO:teuthology.orchestra.run.smithi158.stdout: "reshard_pool": "test-zone1.rgw.log:reshard", 2020-10-05T12:08:59.372 INFO:teuthology.orchestra.run.smithi158.stdout: "user_keys_pool": "test-zone1.rgw.meta:users.keys", 2020-10-05T12:08:59.373 INFO:teuthology.orchestra.run.smithi158.stdout: "user_email_pool": "test-zone1.rgw.meta:users.email", 2020-10-05T12:08:59.373 INFO:teuthology.orchestra.run.smithi158.stdout: "user_swift_pool": "test-zone1.rgw.meta:users.swift", 2020-10-05T12:08:59.374 INFO:teuthology.orchestra.run.smithi158.stdout: "user_uid_pool": "test-zone1.rgw.meta:users.uid", 2020-10-05T12:08:59.374 INFO:teuthology.orchestra.run.smithi158.stdout: "otp_pool": "test-zone1.rgw.otp", 2020-10-05T12:08:59.376 INFO:teuthology.orchestra.run.smithi158.stdout: "system_key": { 2020-10-05T12:08:59.377 INFO:teuthology.orchestra.run.smithi158.stdout: "access_key": "VXETEEL80ZIAZNTY", 2020-10-05T12:08:59.377 INFO:teuthology.orchestra.run.smithi158.stdout: "secret_key": "VZHLnzQpcAVMFERUHp4jMkdrl98D0Bnv" 2020-10-05T12:08:59.377 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.377 INFO:teuthology.orchestra.run.smithi158.stdout: "placement_pools": [ 2020-10-05T12:08:59.377 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.377 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "default-placement", 2020-10-05T12:08:59.378 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:08:59.378 INFO:teuthology.orchestra.run.smithi158.stdout: "index_pool": "test-zone1.rgw.buckets.index", 2020-10-05T12:08:59.378 INFO:teuthology.orchestra.run.smithi158.stdout: "storage_classes": { 2020-10-05T12:08:59.378 INFO:teuthology.orchestra.run.smithi158.stdout: "STANDARD": { 2020-10-05T12:08:59.378 INFO:teuthology.orchestra.run.smithi158.stdout: "data_pool": "test-zone1.rgw.buckets.data", 2020-10-05T12:08:59.378 INFO:teuthology.orchestra.run.smithi158.stdout: "compression_type": "random" 2020-10-05T12:08:59.379 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.379 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.379 INFO:teuthology.orchestra.run.smithi158.stdout: "data_extra_pool": "test-zone1.rgw.buckets.non-ec", 2020-10-05T12:08:59.379 INFO:teuthology.orchestra.run.smithi158.stdout: "index_type": 0 2020-10-05T12:08:59.379 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.379 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.380 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T12:08:59.380 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T12:08:59.380 INFO:teuthology.orchestra.run.smithi158.stdout: "notif_pool": "test-zone1.rgw.log:notif" 2020-10-05T12:08:59.380 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:08:59.381 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:08:59.382 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:08:59.382 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T12:08:59.472 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:08:59.473 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:08:59.770 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:08:59.771 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "51627dfe-772a-407d-b86d-f398684bbf7f", 2020-10-05T12:08:59.771 INFO:teuthology.orchestra.run.smithi158.stdout: "epoch": 1, 2020-10-05T12:08:59.771 INFO:teuthology.orchestra.run.smithi158.stdout: "predecessor_uuid": "de1ec5d2-2844-47c8-bc1d-b6fc2f043687", 2020-10-05T12:08:59.771 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": [ 2020-10-05T12:08:59.772 INFO:teuthology.orchestra.run.smithi158.stdout: "1_1601899738.601888_62.1", 2020-10-05T12:08:59.772 INFO:teuthology.orchestra.run.smithi158.stdout: "", 2020-10-05T12:08:59.772 INFO:teuthology.orchestra.run.smithi158.stdout: "", 2020-10-05T12:08:59.772 INFO:teuthology.orchestra.run.smithi158.stdout: "" 2020-10-05T12:08:59.772 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T12:08:59.773 INFO:teuthology.orchestra.run.smithi158.stdout: "period_map": { 2020-10-05T12:08:59.773 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "51627dfe-772a-407d-b86d-f398684bbf7f", 2020-10-05T12:08:59.773 INFO:teuthology.orchestra.run.smithi158.stdout: "zonegroups": [ 2020-10-05T12:08:59.773 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.774 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "test-zonegroup", 2020-10-05T12:08:59.774 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zonegroup", 2020-10-05T12:08:59.774 INFO:teuthology.orchestra.run.smithi158.stdout: "api_name": "", 2020-10-05T12:08:59.774 INFO:teuthology.orchestra.run.smithi158.stdout: "is_master": "true", 2020-10-05T12:08:59.774 INFO:teuthology.orchestra.run.smithi158.stdout: "endpoints": [ 2020-10-05T12:08:59.775 INFO:teuthology.orchestra.run.smithi158.stdout: "http://smithi158.front.sepia.ceph.com:8000" 2020-10-05T12:08:59.775 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T12:08:59.775 INFO:teuthology.orchestra.run.smithi158.stdout: "hostnames": [], 2020-10-05T12:08:59.775 INFO:teuthology.orchestra.run.smithi158.stdout: "hostnames_s3website": [], 2020-10-05T12:08:59.776 INFO:teuthology.orchestra.run.smithi158.stdout: "master_zone": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T12:08:59.776 INFO:teuthology.orchestra.run.smithi158.stdout: "zones": [ 2020-10-05T12:08:59.776 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.776 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T12:08:59.776 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zone1", 2020-10-05T12:08:59.777 INFO:teuthology.orchestra.run.smithi158.stdout: "endpoints": [ 2020-10-05T12:08:59.777 INFO:teuthology.orchestra.run.smithi158.stdout: "http://smithi158.front.sepia.ceph.com:8000" 2020-10-05T12:08:59.777 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T12:08:59.777 INFO:teuthology.orchestra.run.smithi158.stdout: "log_meta": "false", 2020-10-05T12:08:59.777 INFO:teuthology.orchestra.run.smithi158.stdout: "log_data": "true", 2020-10-05T12:08:59.777 INFO:teuthology.orchestra.run.smithi158.stdout: "bucket_index_max_shards": 11, 2020-10-05T12:08:59.777 INFO:teuthology.orchestra.run.smithi158.stdout: "read_only": "false", 2020-10-05T12:08:59.778 INFO:teuthology.orchestra.run.smithi158.stdout: "tier_type": "", 2020-10-05T12:08:59.778 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from_all": "true", 2020-10-05T12:08:59.778 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from": [], 2020-10-05T12:08:59.778 INFO:teuthology.orchestra.run.smithi158.stdout: "redirect_zone": "" 2020-10-05T12:08:59.778 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.778 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.778 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "7a89cb1a-d0ea-4e52-a3d1-f1de1f9f3d6e", 2020-10-05T12:08:59.779 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zone3", 2020-10-05T12:08:59.779 INFO:teuthology.orchestra.run.smithi158.stdout: "endpoints": [ 2020-10-05T12:08:59.779 INFO:teuthology.orchestra.run.smithi158.stdout: "http://smithi158.front.sepia.ceph.com:8001" 2020-10-05T12:08:59.779 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T12:08:59.779 INFO:teuthology.orchestra.run.smithi158.stdout: "log_meta": "false", 2020-10-05T12:08:59.779 INFO:teuthology.orchestra.run.smithi158.stdout: "log_data": "true", 2020-10-05T12:08:59.779 INFO:teuthology.orchestra.run.smithi158.stdout: "bucket_index_max_shards": 11, 2020-10-05T12:08:59.780 INFO:teuthology.orchestra.run.smithi158.stdout: "read_only": "false", 2020-10-05T12:08:59.780 INFO:teuthology.orchestra.run.smithi158.stdout: "tier_type": "", 2020-10-05T12:08:59.780 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from_all": "true", 2020-10-05T12:08:59.780 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from": [], 2020-10-05T12:08:59.780 INFO:teuthology.orchestra.run.smithi158.stdout: "redirect_zone": "" 2020-10-05T12:08:59.780 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.780 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.780 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T12:08:59.781 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zone2", 2020-10-05T12:08:59.781 INFO:teuthology.orchestra.run.smithi158.stdout: "endpoints": [ 2020-10-05T12:08:59.781 INFO:teuthology.orchestra.run.smithi158.stdout: "http://smithi081.front.sepia.ceph.com:8000" 2020-10-05T12:08:59.781 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T12:08:59.781 INFO:teuthology.orchestra.run.smithi158.stdout: "log_meta": "false", 2020-10-05T12:08:59.781 INFO:teuthology.orchestra.run.smithi158.stdout: "log_data": "true", 2020-10-05T12:08:59.781 INFO:teuthology.orchestra.run.smithi158.stdout: "bucket_index_max_shards": 11, 2020-10-05T12:08:59.782 INFO:teuthology.orchestra.run.smithi158.stdout: "read_only": "false", 2020-10-05T12:08:59.782 INFO:teuthology.orchestra.run.smithi158.stdout: "tier_type": "", 2020-10-05T12:08:59.782 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from_all": "true", 2020-10-05T12:08:59.782 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from": [], 2020-10-05T12:08:59.782 INFO:teuthology.orchestra.run.smithi158.stdout: "redirect_zone": "" 2020-10-05T12:08:59.782 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.782 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.783 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "d4a952c4-a878-4b40-9af3-dc61e86204eb", 2020-10-05T12:08:59.783 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "test-zone4", 2020-10-05T12:08:59.783 INFO:teuthology.orchestra.run.smithi158.stdout: "endpoints": [ 2020-10-05T12:08:59.783 INFO:teuthology.orchestra.run.smithi158.stdout: "http://smithi081.front.sepia.ceph.com:8001" 2020-10-05T12:08:59.783 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T12:08:59.783 INFO:teuthology.orchestra.run.smithi158.stdout: "log_meta": "false", 2020-10-05T12:08:59.783 INFO:teuthology.orchestra.run.smithi158.stdout: "log_data": "true", 2020-10-05T12:08:59.784 INFO:teuthology.orchestra.run.smithi158.stdout: "bucket_index_max_shards": 11, 2020-10-05T12:08:59.784 INFO:teuthology.orchestra.run.smithi158.stdout: "read_only": "false", 2020-10-05T12:08:59.784 INFO:teuthology.orchestra.run.smithi158.stdout: "tier_type": "pubsub", 2020-10-05T12:08:59.784 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from_all": "false", 2020-10-05T12:08:59.784 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_from": [ 2020-10-05T12:08:59.784 INFO:teuthology.orchestra.run.smithi158.stdout: "test-zone1" 2020-10-05T12:08:59.784 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T12:08:59.784 INFO:teuthology.orchestra.run.smithi158.stdout: "redirect_zone": "" 2020-10-05T12:08:59.785 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.785 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T12:08:59.785 INFO:teuthology.orchestra.run.smithi158.stdout: "placement_targets": [ 2020-10-05T12:08:59.785 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.785 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "default-placement", 2020-10-05T12:08:59.785 INFO:teuthology.orchestra.run.smithi158.stdout: "tags": [], 2020-10-05T12:08:59.785 INFO:teuthology.orchestra.run.smithi158.stdout: "storage_classes": [ 2020-10-05T12:08:59.786 INFO:teuthology.orchestra.run.smithi158.stdout: "STANDARD" 2020-10-05T12:08:59.786 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:08:59.786 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.786 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T12:08:59.786 INFO:teuthology.orchestra.run.smithi158.stdout: "default_placement": "default-placement", 2020-10-05T12:08:59.786 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T12:08:59.786 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_policy": { 2020-10-05T12:08:59.787 INFO:teuthology.orchestra.run.smithi158.stdout: "groups": [] 2020-10-05T12:08:59.787 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.787 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.787 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2020-10-05T12:08:59.796 INFO:teuthology.orchestra.run.smithi158.stdout: "short_zone_ids": [ 2020-10-05T12:08:59.797 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.797 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T12:08:59.797 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 3324834999 2020-10-05T12:08:59.797 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.797 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.798 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "7a89cb1a-d0ea-4e52-a3d1-f1de1f9f3d6e", 2020-10-05T12:08:59.798 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 2396638170 2020-10-05T12:08:59.798 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.798 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.798 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "bdf35e5b-c653-4ef8-994d-7961e459db28", 2020-10-05T12:08:59.798 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 4213498805 2020-10-05T12:08:59.798 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.799 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:08:59.799 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "d4a952c4-a878-4b40-9af3-dc61e86204eb", 2020-10-05T12:08:59.799 INFO:teuthology.orchestra.run.smithi158.stdout: "val": 3646836627 2020-10-05T12:08:59.799 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.799 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:08:59.799 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.799 INFO:teuthology.orchestra.run.smithi158.stdout: "master_zonegroup": "test-zonegroup", 2020-10-05T12:08:59.800 INFO:teuthology.orchestra.run.smithi158.stdout: "master_zone": "35a06950-5b24-42ca-86ff-3dc913eb1ccc", 2020-10-05T12:08:59.800 INFO:teuthology.orchestra.run.smithi158.stdout: "period_config": { 2020-10-05T12:08:59.800 INFO:teuthology.orchestra.run.smithi158.stdout: "bucket_quota": { 2020-10-05T12:08:59.800 INFO:teuthology.orchestra.run.smithi158.stdout: "enabled": false, 2020-10-05T12:08:59.800 INFO:teuthology.orchestra.run.smithi158.stdout: "check_on_raw": false, 2020-10-05T12:08:59.800 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size": -1, 2020-10-05T12:08:59.800 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size_kb": 0, 2020-10-05T12:08:59.800 INFO:teuthology.orchestra.run.smithi158.stdout: "max_objects": -1 2020-10-05T12:08:59.801 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.801 INFO:teuthology.orchestra.run.smithi158.stdout: "user_quota": { 2020-10-05T12:08:59.801 INFO:teuthology.orchestra.run.smithi158.stdout: "enabled": false, 2020-10-05T12:08:59.801 INFO:teuthology.orchestra.run.smithi158.stdout: "check_on_raw": false, 2020-10-05T12:08:59.801 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size": -1, 2020-10-05T12:08:59.801 INFO:teuthology.orchestra.run.smithi158.stdout: "max_size_kb": 0, 2020-10-05T12:08:59.801 INFO:teuthology.orchestra.run.smithi158.stdout: "max_objects": -1 2020-10-05T12:08:59.802 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:08:59.802 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:08:59.802 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_id": "5d355ff6-57c8-43c7-aa39-a3d6a281a382", 2020-10-05T12:08:59.802 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_name": "test-realm", 2020-10-05T12:08:59.802 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 4 2020-10-05T12:08:59.802 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:08:59.804 INFO:rgw_multi.tests:Set master zone=test-zone1, waiting 60s for reconfiguration.. 2020-10-05T12:09:59.805 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-44 2020-10-05T12:09:59.847 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-45 2020-10-05T12:09:59.923 INFO:tasks.rgw.c1.client.1:Restarting daemon 2020-10-05T12:09:59.924 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.1.stdout 2>&1 2020-10-05T12:09:59.926 INFO:tasks.rgw.c1.client.1:Started 2020-10-05T12:09:59.927 INFO:teuthology.orchestra.run.smithi158:> curl http://smithi158.front.sepia.ceph.com:8001 2020-10-05T12:09:59.944 INFO:teuthology.orchestra.run.smithi158.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T12:09:59.944 INFO:teuthology.orchestra.run.smithi158.stderr: Dload Upload Total Spent Left Speed 2020-10-05T12:09:59.948 INFO:teuthology.orchestra.run.smithi158.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi158.front.sepia.ceph.com port 8001: Connection refused 2020-10-05T12:09:59.949 DEBUG:teuthology.orchestra.run:got remote process result: 7 2020-10-05T12:10:00.950 INFO:teuthology.orchestra.run.smithi158:> curl http://smithi158.front.sepia.ceph.com:8001 2020-10-05T12:10:00.964 INFO:teuthology.orchestra.run.smithi158.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-10-05T12:10:00.965 INFO:teuthology.orchestra.run.smithi158.stderr: Dload Upload Total Spent Left Speed 2020-10-05T12:10:00.969 INFO:teuthology.orchestra.run.smithi158.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2020-10-05T12:10:00.970 INFO:teuthology.orchestra.run.smithi158.stdout:anonymous 2020-10-05T12:10:00.971 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:00.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:00.972 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:01.053 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:01.054 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:01.254 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=51627dfe-772a-407d-b86d-f398684bbf7f 2020-10-05T12:10:01.283 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:10:01.284 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:01.284 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899799.896592_169.1", 2020-10-05T12:10:01.284 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:09:59.896592Z" 2020-10-05T12:10:01.284 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:01.284 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:01.284 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:10:01.285 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:10:01.285 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:01.285 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:01.285 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:10:01.285 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:10:01.285 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:01.285 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:01.286 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:10:01.286 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:10:01.286 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:01.286 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:10:01.287 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T12:10:01.287 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:01.288 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:01.288 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:01.580 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:10:01.580 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:10:01.580 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:10:01.581 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:10:01.581 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:10:01.581 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "51627dfe-772a-407d-b86d-f398684bbf7f", 2020-10-05T12:10:01.581 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 4 2020-10-05T12:10:01.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:01.581 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:10:01.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:01.582 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:10:01.582 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:01.582 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:01.582 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899799.896592_169.1", 2020-10-05T12:10:01.582 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:01.582 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:10:01.583 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:01.583 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.896592Z", 2020-10-05T12:10:01.584 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 4 2020-10-05T12:10:01.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:01.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:01.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:01.585 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:10:01.585 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:01.585 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:01.586 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:10:01.586 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:01.586 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:01.586 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:01.586 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:10:01.586 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:10:01.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:01.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:01.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:01.587 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:10:01.587 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:01.587 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:01.588 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:10:01.588 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:01.588 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:01.588 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:01.588 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:10:01.588 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:10:01.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:01.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:01.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:01.589 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:10:01.589 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:01.589 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:01.589 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:10:01.589 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:01.590 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:01.590 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:01.590 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:10:01.590 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:10:01.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:01.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:01.590 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:10:01.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:01.591 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:10:01.591 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:10:01.591 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:10:01.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:01.591 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:10:01.592 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T12:10:01.593 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T12:10:01.593 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:01.594 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:01.594 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:01.635 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:01.636 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:01.895 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:10:01.896 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:10:01.896 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:10:01.896 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:10:01.896 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:10:01.896 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "51627dfe-772a-407d-b86d-f398684bbf7f", 2020-10-05T12:10:01.896 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 4 2020-10-05T12:10:01.897 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:01.897 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:10:01.897 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:01.897 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:10:01.897 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:01.897 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:10:01.897 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899799.896592_169.1", 2020-10-05T12:10:01.897 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:01.898 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T12:10:01.898 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:01.898 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.896592Z", 2020-10-05T12:10:01.898 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 4 2020-10-05T12:10:01.898 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:01.898 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:01.899 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:01.899 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:10:01.899 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:01.899 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:10:01.899 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:10:01.899 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:01.899 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:01.899 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:01.900 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:10:01.900 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:10:01.900 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:01.900 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:01.900 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:01.900 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:10:01.900 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:01.901 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:10:01.901 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:10:01.901 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:01.901 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:01.901 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:01.901 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:10:01.901 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:10:01.902 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:01.902 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:01.902 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:01.902 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:10:01.902 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:01.902 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:10:01.902 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:10:01.902 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:01.903 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:01.903 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:01.903 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:10:01.903 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:10:01.903 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:01.903 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:01.904 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:10:01.904 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:01.904 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:10:01.904 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T12:10:01.904 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T12:10:01.904 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:01.904 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:10:01.906 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T12:10:01.906 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T12:10:01.906 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:01.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:01.907 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:01.946 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:01.947 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:02.212 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:10:02.212 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:10:02.213 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:10:02.213 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:10:02.213 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:10:02.213 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "51627dfe-772a-407d-b86d-f398684bbf7f", 2020-10-05T12:10:02.213 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 4 2020-10-05T12:10:02.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:02.213 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:10:02.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:02.214 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:10:02.214 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:02.214 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:02.214 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899799.896592_169.1", 2020-10-05T12:10:02.214 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:02.215 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:10:02.215 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:02.215 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.896592Z", 2020-10-05T12:10:02.215 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 4 2020-10-05T12:10:02.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:02.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:02.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:02.216 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:10:02.216 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:02.216 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:02.216 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:10:02.216 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:02.216 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:02.216 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:02.217 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:10:02.217 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:10:02.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:02.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:02.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:02.217 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:10:02.217 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:02.218 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:02.218 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:10:02.218 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:02.218 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:02.218 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:02.218 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:10:02.218 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:10:02.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:02.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:02.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:02.219 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:10:02.219 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:02.219 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:02.219 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:10:02.220 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:02.220 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:02.220 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:02.220 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:10:02.220 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:10:02.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:02.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:02.220 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:10:02.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:02.221 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:10:02.221 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:10:02.221 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:10:02.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:02.221 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:10:02.222 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T12:10:02.223 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-39 zones={test-zone2, test-zone1} 2020-10-05T12:10:02.246 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:02.295 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:02.357 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-39 zones={test-zone2, test-zone1} 2020-10-05T12:10:02.358 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-39 zones={test-zone3, test-zone1} 2020-10-05T12:10:02.374 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:02.422 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:02.485 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-39 zones={test-zone3, test-zone1} 2020-10-05T12:10:02.485 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-39 zones={test-zone1, test-zone2} 2020-10-05T12:10:02.497 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:02.543 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:02.605 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-39 zones={test-zone1, test-zone2} 2020-10-05T12:10:02.606 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-39 zones={test-zone3, test-zone2} 2020-10-05T12:10:02.617 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:02.666 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:02.730 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-39 zones={test-zone3, test-zone2} 2020-10-05T12:10:02.730 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-39 zones={test-zone1, test-zone3} 2020-10-05T12:10:02.742 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:02.790 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:02.853 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-39 zones={test-zone1, test-zone3} 2020-10-05T12:10:02.853 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-39 zones={test-zone2, test-zone3} 2020-10-05T12:10:02.865 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:02.914 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:02.977 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-39 zones={test-zone2, test-zone3} 2020-10-05T12:10:02.977 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-40 zones={test-zone2, test-zone1} 2020-10-05T12:10:02.992 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:03.042 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:03.111 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-40 zones={test-zone2, test-zone1} 2020-10-05T12:10:03.112 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-40 zones={test-zone3, test-zone1} 2020-10-05T12:10:03.125 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:03.174 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:03.236 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-40 zones={test-zone3, test-zone1} 2020-10-05T12:10:03.237 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-40 zones={test-zone1, test-zone2} 2020-10-05T12:10:03.247 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:03.294 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:03.358 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-40 zones={test-zone1, test-zone2} 2020-10-05T12:10:03.359 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-40 zones={test-zone3, test-zone2} 2020-10-05T12:10:03.368 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:03.418 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:03.481 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-40 zones={test-zone3, test-zone2} 2020-10-05T12:10:03.481 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-40 zones={test-zone1, test-zone3} 2020-10-05T12:10:03.493 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:03.538 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:03.600 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-40 zones={test-zone1, test-zone3} 2020-10-05T12:10:03.601 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-40 zones={test-zone2, test-zone3} 2020-10-05T12:10:03.611 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:03.658 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:03.721 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-40 zones={test-zone2, test-zone3} 2020-10-05T12:10:03.721 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-41 zones={test-zone2, test-zone1} 2020-10-05T12:10:03.738 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:03.786 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:03.857 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-41 zones={test-zone2, test-zone1} 2020-10-05T12:10:03.858 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-41 zones={test-zone3, test-zone1} 2020-10-05T12:10:03.868 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:03.914 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:03.978 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-41 zones={test-zone3, test-zone1} 2020-10-05T12:10:03.979 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-41 zones={test-zone1, test-zone2} 2020-10-05T12:10:03.989 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:04.039 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:04.102 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-41 zones={test-zone1, test-zone2} 2020-10-05T12:10:04.103 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-41 zones={test-zone3, test-zone2} 2020-10-05T12:10:04.114 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:04.166 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:04.229 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-41 zones={test-zone3, test-zone2} 2020-10-05T12:10:04.230 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-41 zones={test-zone1, test-zone3} 2020-10-05T12:10:04.241 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:04.290 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:04.361 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-41 zones={test-zone1, test-zone3} 2020-10-05T12:10:04.362 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-41 zones={test-zone2, test-zone3} 2020-10-05T12:10:04.371 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:04.418 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:04.481 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-41 zones={test-zone2, test-zone3} 2020-10-05T12:10:04.482 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-42 zones={test-zone2, test-zone1} 2020-10-05T12:10:04.493 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:04.542 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:04.605 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-42 zones={test-zone2, test-zone1} 2020-10-05T12:10:04.606 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-42 zones={test-zone3, test-zone1} 2020-10-05T12:10:04.615 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:04.662 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:04.724 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-42 zones={test-zone3, test-zone1} 2020-10-05T12:10:04.725 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-42 zones={test-zone1, test-zone2} 2020-10-05T12:10:04.735 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:04.782 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:04.846 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-42 zones={test-zone1, test-zone2} 2020-10-05T12:10:04.847 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-42 zones={test-zone3, test-zone2} 2020-10-05T12:10:04.856 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:04.902 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:04.969 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-42 zones={test-zone3, test-zone2} 2020-10-05T12:10:04.970 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-42 zones={test-zone1, test-zone3} 2020-10-05T12:10:04.981 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:05.026 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:05.084 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-42 zones={test-zone1, test-zone3} 2020-10-05T12:10:05.084 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-42 zones={test-zone2, test-zone3} 2020-10-05T12:10:05.096 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:05.142 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:05.205 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-42 zones={test-zone2, test-zone3} 2020-10-05T12:10:05.207 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-43 zones={test-zone2, test-zone1} 2020-10-05T12:10:05.219 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:05.266 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:05.341 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-43 zones={test-zone2, test-zone1} 2020-10-05T12:10:05.341 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-43 zones={test-zone3, test-zone1} 2020-10-05T12:10:05.352 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:05.398 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:05.460 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-43 zones={test-zone3, test-zone1} 2020-10-05T12:10:05.461 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-43 zones={test-zone1, test-zone2} 2020-10-05T12:10:05.473 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:05.518 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:05.581 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-43 zones={test-zone1, test-zone2} 2020-10-05T12:10:05.582 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-43 zones={test-zone3, test-zone2} 2020-10-05T12:10:05.594 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:05.642 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:05.705 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-43 zones={test-zone3, test-zone2} 2020-10-05T12:10:05.705 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-43 zones={test-zone1, test-zone3} 2020-10-05T12:10:05.717 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:05.766 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:05.828 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-43 zones={test-zone1, test-zone3} 2020-10-05T12:10:05.829 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-43 zones={test-zone2, test-zone3} 2020-10-05T12:10:05.839 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:05.890 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:05.953 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-43 zones={test-zone2, test-zone3} 2020-10-05T12:10:05.953 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-44 zones={test-zone2, test-zone1} 2020-10-05T12:10:05.963 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:06.010 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:06.073 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-44 zones={test-zone2, test-zone1} 2020-10-05T12:10:06.074 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-44 zones={test-zone3, test-zone1} 2020-10-05T12:10:06.082 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:06.130 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:06.193 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-44 zones={test-zone3, test-zone1} 2020-10-05T12:10:06.194 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-44 zones={test-zone1, test-zone2} 2020-10-05T12:10:06.204 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:06.254 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:06.320 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-44 zones={test-zone1, test-zone2} 2020-10-05T12:10:06.321 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-44 zones={test-zone3, test-zone2} 2020-10-05T12:10:06.332 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:06.382 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:06.449 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-44 zones={test-zone3, test-zone2} 2020-10-05T12:10:06.449 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-44 zones={test-zone1, test-zone3} 2020-10-05T12:10:06.462 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:06.514 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:06.576 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-44 zones={test-zone1, test-zone3} 2020-10-05T12:10:06.577 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-44 zones={test-zone2, test-zone3} 2020-10-05T12:10:06.587 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:06.634 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:06.697 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-44 zones={test-zone2, test-zone3} 2020-10-05T12:10:06.698 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-45 zones={test-zone2, test-zone1} 2020-10-05T12:10:06.706 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:06.754 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:06.818 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-45 zones={test-zone2, test-zone1} 2020-10-05T12:10:06.818 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-45 zones={test-zone3, test-zone1} 2020-10-05T12:10:06.827 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:06.874 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:06.937 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-45 zones={test-zone3, test-zone1} 2020-10-05T12:10:06.938 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-45 zones={test-zone1, test-zone2} 2020-10-05T12:10:06.951 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:06.998 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:07.065 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-45 zones={test-zone1, test-zone2} 2020-10-05T12:10:07.066 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-45 zones={test-zone3, test-zone2} 2020-10-05T12:10:07.075 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:07.122 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:07.185 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-45 zones={test-zone3, test-zone2} 2020-10-05T12:10:07.186 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-45 zones={test-zone1, test-zone3} 2020-10-05T12:10:07.201 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:07.246 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:07.309 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-45 zones={test-zone1, test-zone3} 2020-10-05T12:10:07.310 INFO:tasks.rgw_multi.zone_rados:comparing bucket=dzadif-45 zones={test-zone2, test-zone3} 2020-10-05T12:10:07.321 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2020-10-05T12:10:07.370 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2020-10-05T12:10:07.433 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=dzadif-45 zones={test-zone2, test-zone3} 2020-10-05T12:10:07.434 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:07.434 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:07.435 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period eb044115-4632-4a42-8790-5052d87ef1c6 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:07.471 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:07.471 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:07.700 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:10:07.700 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.700 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899010.522064_46.1", 2020-10-05T12:10:07.700 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "user", 2020-10-05T12:10:07.700 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "rgw-multisite-test-user", 2020-10-05T12:10:07.701 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:56:50.522064827Z", 2020-10-05T12:10:07.701 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.701 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.701 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.701 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.701 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.702 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.702 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_XfLljzuaU2vSQ_l6_rZc8Jd", 2020-10-05T12:10:07.702 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.702 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.702 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.703 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.703 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.703 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.703 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.703 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.703 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899010.531704_48.1", 2020-10-05T12:10:07.703 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "user", 2020-10-05T12:10:07.704 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "rgw-multisite-test-user", 2020-10-05T12:10:07.704 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:56:50.531704315Z", 2020-10-05T12:10:07.704 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.704 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.704 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.704 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.705 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.705 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.705 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_XfLljzuaU2vSQ_l6_rZc8Jd", 2020-10-05T12:10:07.705 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.706 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.706 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.706 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.706 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.706 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.706 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.707 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.707 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.814004_49.1", 2020-10-05T12:10:07.707 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.707 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-10:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.10", 2020-10-05T12:10:07.707 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.814004723Z", 2020-10-05T12:10:07.708 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.708 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.708 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.708 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.708 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.708 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.708 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_OUeyPbMbUBT7BQCU4es-77f", 2020-10-05T12:10:07.709 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.709 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.709 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.709 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.709 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.709 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.709 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.710 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.710 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.820735_57.1", 2020-10-05T12:10:07.710 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.710 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-10:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.10", 2020-10-05T12:10:07.710 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.820735262Z", 2020-10-05T12:10:07.710 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.710 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.711 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.711 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.711 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.711 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.711 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_OUeyPbMbUBT7BQCU4es-77f", 2020-10-05T12:10:07.712 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.712 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.712 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.712 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.712 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.713 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.713 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.713 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.713 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.824910_58.1", 2020-10-05T12:10:07.713 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.714 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-10", 2020-10-05T12:10:07.714 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.824910635Z", 2020-10-05T12:10:07.714 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.714 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.714 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.714 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.715 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.715 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.715 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_0Xb0nTNWivrWvWx3oeYmdD5", 2020-10-05T12:10:07.715 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.715 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.715 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.716 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.716 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.716 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.716 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.716 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.716 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.833730_59.1", 2020-10-05T12:10:07.716 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.717 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-10", 2020-10-05T12:10:07.717 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.833730650Z", 2020-10-05T12:10:07.717 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.717 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.717 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.717 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.718 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.718 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.718 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_0Xb0nTNWivrWvWx3oeYmdD5", 2020-10-05T12:10:07.718 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.718 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.719 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.719 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.719 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.719 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.719 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.719 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.719 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.857632_61.1", 2020-10-05T12:10:07.720 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.720 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-11:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.11", 2020-10-05T12:10:07.720 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.857632138Z", 2020-10-05T12:10:07.720 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.720 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.720 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.720 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.721 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.721 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.721 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_v4mkZAXP0-Rav1j3dZSpNti", 2020-10-05T12:10:07.721 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.721 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.721 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.721 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.722 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.722 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.722 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.722 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.722 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.862394_62.1", 2020-10-05T12:10:07.722 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.722 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-11:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.11", 2020-10-05T12:10:07.723 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.862394648Z", 2020-10-05T12:10:07.723 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.723 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.723 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.723 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.723 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.723 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.724 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_v4mkZAXP0-Rav1j3dZSpNti", 2020-10-05T12:10:07.724 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.724 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.724 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.724 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.724 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.724 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.725 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.725 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.725 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.864807_63.1", 2020-10-05T12:10:07.725 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.725 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-11", 2020-10-05T12:10:07.726 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.864807231Z", 2020-10-05T12:10:07.726 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.726 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.726 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.726 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.726 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.726 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.727 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_L1Lb50oCzKfeW6cLgFCXcoO", 2020-10-05T12:10:07.727 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.727 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.727 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.727 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.727 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.727 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.728 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.728 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.728 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.872602_64.1", 2020-10-05T12:10:07.728 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.728 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-11", 2020-10-05T12:10:07.728 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.872602240Z", 2020-10-05T12:10:07.728 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.729 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.729 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.729 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.729 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.729 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.729 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_L1Lb50oCzKfeW6cLgFCXcoO", 2020-10-05T12:10:07.730 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.730 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.730 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.730 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.730 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.730 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.730 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.731 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.731 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.914339_65.1", 2020-10-05T12:10:07.731 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.731 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-12:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.12", 2020-10-05T12:10:07.731 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.914339616Z", 2020-10-05T12:10:07.731 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.731 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.732 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.732 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.732 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.732 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.732 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_KBFql2QH92IFaRoA6pUczcF", 2020-10-05T12:10:07.732 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.732 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.733 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.733 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.733 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.733 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.733 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.733 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.733 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.918665_66.1", 2020-10-05T12:10:07.733 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.734 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-12:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.12", 2020-10-05T12:10:07.734 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.918665490Z", 2020-10-05T12:10:07.734 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.734 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.734 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.734 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.734 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.735 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.735 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_KBFql2QH92IFaRoA6pUczcF", 2020-10-05T12:10:07.735 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.735 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.735 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.735 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.735 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.736 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.736 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.736 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.736 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.920603_67.1", 2020-10-05T12:10:07.736 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.736 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-12", 2020-10-05T12:10:07.736 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.920603439Z", 2020-10-05T12:10:07.736 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.737 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.737 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.737 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.737 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.737 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.737 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_TSIbo46j-8sw-hblvAeS41m", 2020-10-05T12:10:07.737 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.738 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.738 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.738 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.738 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.738 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.738 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.738 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.738 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.924911_68.1", 2020-10-05T12:10:07.739 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.739 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-12", 2020-10-05T12:10:07.739 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.924911466Z", 2020-10-05T12:10:07.739 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.739 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.739 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.739 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.740 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.740 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.740 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_TSIbo46j-8sw-hblvAeS41m", 2020-10-05T12:10:07.740 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.740 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.740 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.740 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.741 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.741 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.741 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.741 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.741 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.705730_167.1", 2020-10-05T12:10:07.741 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.741 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-13:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.13", 2020-10-05T12:10:07.742 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.705730871Z", 2020-10-05T12:10:07.742 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.742 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.742 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.742 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.742 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.742 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.742 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_fKSRurQRBwqim7c5GEU0PUo", 2020-10-05T12:10:07.743 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.743 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.743 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.743 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.743 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.743 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.743 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.744 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.744 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.709947_170.1", 2020-10-05T12:10:07.744 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.744 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-13:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.13", 2020-10-05T12:10:07.744 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.709947223Z", 2020-10-05T12:10:07.744 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.744 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.745 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.745 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.745 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.745 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.745 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_fKSRurQRBwqim7c5GEU0PUo", 2020-10-05T12:10:07.745 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.746 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.746 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.746 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.746 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.747 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.747 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.747 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.747 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.711830_171.1", 2020-10-05T12:10:07.747 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.748 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-13", 2020-10-05T12:10:07.748 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.711830069Z", 2020-10-05T12:10:07.748 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.748 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.749 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.749 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.749 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.749 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.749 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_6qCjZsmNHmFw8bpyRgfhvgp", 2020-10-05T12:10:07.749 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.749 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.750 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.750 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.750 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.750 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.751 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.751 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.751 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.715644_172.1", 2020-10-05T12:10:07.751 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.751 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-13", 2020-10-05T12:10:07.751 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.715644136Z", 2020-10-05T12:10:07.751 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.752 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.752 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.752 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.752 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.752 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.752 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_6qCjZsmNHmFw8bpyRgfhvgp", 2020-10-05T12:10:07.752 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.753 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.753 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.753 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.753 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.753 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.753 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.754 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.754 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.735814_173.1", 2020-10-05T12:10:07.754 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.754 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-14:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.14", 2020-10-05T12:10:07.754 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.735814205Z", 2020-10-05T12:10:07.755 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.755 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.755 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.755 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.755 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.755 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.756 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_4DMFEEdE_URAKSdIzf9-FJr", 2020-10-05T12:10:07.756 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.756 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.756 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.756 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.756 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.756 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.756 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.757 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.757 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.740366_174.1", 2020-10-05T12:10:07.757 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.757 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-14:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.14", 2020-10-05T12:10:07.757 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.740366438Z", 2020-10-05T12:10:07.757 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.757 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.758 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.758 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.758 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.758 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.758 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_4DMFEEdE_URAKSdIzf9-FJr", 2020-10-05T12:10:07.758 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.759 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.759 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.759 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.759 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.759 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.759 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.759 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.760 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.743243_175.1", 2020-10-05T12:10:07.760 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.760 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-14", 2020-10-05T12:10:07.760 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.743243682Z", 2020-10-05T12:10:07.760 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.760 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.760 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.761 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.761 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.761 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.761 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UIQfkMuDK3qo2qDganeuBr3", 2020-10-05T12:10:07.761 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.761 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.761 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.762 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.762 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.762 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.762 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.762 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.762 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.748706_176.1", 2020-10-05T12:10:07.762 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.763 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-14", 2020-10-05T12:10:07.763 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.748706141Z", 2020-10-05T12:10:07.763 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.763 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.763 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.764 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.764 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.764 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.764 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UIQfkMuDK3qo2qDganeuBr3", 2020-10-05T12:10:07.764 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.764 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.765 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.765 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.765 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.765 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.765 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.765 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.766 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.800203_177.1", 2020-10-05T12:10:07.766 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.766 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-15:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.15", 2020-10-05T12:10:07.766 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.800203983Z", 2020-10-05T12:10:07.766 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.767 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.767 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.767 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.767 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.767 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.767 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_3-e1Ii4K_TT4M1zQxUiOW6q", 2020-10-05T12:10:07.767 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.768 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.768 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.768 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.768 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.768 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.768 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.768 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.768 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.807858_178.1", 2020-10-05T12:10:07.769 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.769 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-15:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.15", 2020-10-05T12:10:07.769 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.807858930Z", 2020-10-05T12:10:07.769 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.769 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.769 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.769 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.770 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.770 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.770 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_3-e1Ii4K_TT4M1zQxUiOW6q", 2020-10-05T12:10:07.770 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.770 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.770 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.771 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.771 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.771 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.771 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.771 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.771 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.810402_179.1", 2020-10-05T12:10:07.771 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.772 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-15", 2020-10-05T12:10:07.772 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.810402748Z", 2020-10-05T12:10:07.772 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.772 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.772 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.773 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.773 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.773 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.773 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pIn_cx-kgGjdDSA4gCi-AHV", 2020-10-05T12:10:07.773 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.773 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.773 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.774 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.774 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.774 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.774 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.775 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.775 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.815329_180.1", 2020-10-05T12:10:07.775 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.775 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-15", 2020-10-05T12:10:07.775 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.815329634Z", 2020-10-05T12:10:07.775 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.775 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.776 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.776 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.776 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.777 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.777 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pIn_cx-kgGjdDSA4gCi-AHV", 2020-10-05T12:10:07.777 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.777 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.777 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.778 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.778 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.778 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.779 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.779 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.779 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.087142_206.1", 2020-10-05T12:10:07.779 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.779 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:07.779 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.087142258Z", 2020-10-05T12:10:07.780 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.780 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.780 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.780 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.780 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.781 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.781 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:07.781 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.781 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.782 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.782 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.782 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.782 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.782 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.783 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.783 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.092441_208.1", 2020-10-05T12:10:07.783 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.783 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:07.783 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.092441445Z", 2020-10-05T12:10:07.784 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.784 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.784 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.784 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.784 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.784 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.784 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:07.785 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.785 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.785 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.785 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.785 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.785 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.785 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.786 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.786 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.094590_209.1", 2020-10-05T12:10:07.786 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.786 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-16", 2020-10-05T12:10:07.786 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.094590609Z", 2020-10-05T12:10:07.786 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.786 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.787 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.787 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.787 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.787 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.787 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_19VzZjSbKDNxSKagtOnJpeP", 2020-10-05T12:10:07.787 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.788 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.788 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.788 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.788 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.789 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.789 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.789 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.789 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.098781_210.1", 2020-10-05T12:10:07.789 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.789 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-16", 2020-10-05T12:10:07.789 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.098781140Z", 2020-10-05T12:10:07.790 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.790 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.790 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.790 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.790 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.791 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.791 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_19VzZjSbKDNxSKagtOnJpeP", 2020-10-05T12:10:07.791 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.791 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.791 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.791 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.792 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.792 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.792 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.792 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.793 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.123698_211.1", 2020-10-05T12:10:07.793 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.793 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:07.793 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.123698075Z", 2020-10-05T12:10:07.793 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.793 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.793 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.794 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.794 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.794 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.794 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:07.794 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.794 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.794 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.795 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.795 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.795 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.795 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.795 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.795 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.128567_212.1", 2020-10-05T12:10:07.795 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.796 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:07.796 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.128567062Z", 2020-10-05T12:10:07.796 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.796 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.796 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.796 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.796 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.797 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.797 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:07.797 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.797 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.797 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.797 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.797 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.798 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.798 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.798 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.798 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.130568_213.1", 2020-10-05T12:10:07.798 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.798 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-17", 2020-10-05T12:10:07.798 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.130568070Z", 2020-10-05T12:10:07.799 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.799 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.799 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.799 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.799 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.799 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.799 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q4C4WlcctcpJbNFl9-F-oBc", 2020-10-05T12:10:07.799 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.800 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.800 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.800 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.800 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.800 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.800 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.800 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.801 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.134679_214.1", 2020-10-05T12:10:07.801 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.801 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-17", 2020-10-05T12:10:07.801 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.134679951Z", 2020-10-05T12:10:07.801 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.801 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.801 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.801 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.802 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.802 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.802 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q4C4WlcctcpJbNFl9-F-oBc", 2020-10-05T12:10:07.802 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.802 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.802 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.802 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.803 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.803 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.803 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.803 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.803 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.176345_215.1", 2020-10-05T12:10:07.803 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.803 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:07.804 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.176345246Z", 2020-10-05T12:10:07.804 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.804 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.804 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.804 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.804 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.804 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.805 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:07.805 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.805 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.805 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.805 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.805 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.805 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.805 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.806 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.806 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.181063_216.1", 2020-10-05T12:10:07.806 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.806 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:07.806 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.181063933Z", 2020-10-05T12:10:07.806 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.806 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.807 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.807 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.807 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.807 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.807 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:07.807 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.807 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.808 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.808 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.808 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.808 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.808 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.808 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.808 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.183114_217.1", 2020-10-05T12:10:07.808 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.809 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-18", 2020-10-05T12:10:07.809 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.183114762Z", 2020-10-05T12:10:07.809 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.809 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.809 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.809 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.809 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.810 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.810 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rsmMMhH9J_A9xJxzE-ZmVue", 2020-10-05T12:10:07.810 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.810 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.810 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.810 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.810 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.811 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.811 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.811 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.811 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.187062_218.1", 2020-10-05T12:10:07.811 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.811 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-18", 2020-10-05T12:10:07.811 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.187062554Z", 2020-10-05T12:10:07.811 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.812 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.812 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.812 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.812 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.812 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.812 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rsmMMhH9J_A9xJxzE-ZmVue", 2020-10-05T12:10:07.812 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.813 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.813 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.813 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.813 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.813 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.813 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.813 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.813 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.209336_219.1", 2020-10-05T12:10:07.814 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.814 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:07.814 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.209336756Z", 2020-10-05T12:10:07.814 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.814 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.814 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:07.814 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.815 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.815 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.815 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:07.815 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.815 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.815 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.816 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.816 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.816 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.816 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.816 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.816 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.221609_220.1", 2020-10-05T12:10:07.817 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.817 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:07.817 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.221609923Z", 2020-10-05T12:10:07.817 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.817 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.817 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:07.817 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.818 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.818 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.818 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:07.818 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.818 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.818 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.818 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.819 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.819 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.819 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.819 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.819 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.229421_221.1", 2020-10-05T12:10:07.819 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.819 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:07.819 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.229421160Z", 2020-10-05T12:10:07.820 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.820 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.820 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:07.820 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.820 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.820 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.820 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:07.821 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.821 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.821 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.821 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.821 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.821 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.821 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.822 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.822 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.237256_222.1", 2020-10-05T12:10:07.822 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.822 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:07.822 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.237256353Z", 2020-10-05T12:10:07.822 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.822 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.823 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:07.823 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.823 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.823 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.823 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:07.823 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.823 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.823 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.824 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.824 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.824 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.824 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.824 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.824 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.249534_223.1", 2020-10-05T12:10:07.824 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.825 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:07.825 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.249534958Z", 2020-10-05T12:10:07.825 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.825 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.825 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:07.825 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.825 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.826 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.826 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:07.826 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.826 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.826 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.826 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.826 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.826 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.827 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.827 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.827 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.261322_224.1", 2020-10-05T12:10:07.827 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.827 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:07.827 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.261322106Z", 2020-10-05T12:10:07.827 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.828 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.828 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:07.828 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.828 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.828 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.828 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:07.828 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.829 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.829 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.829 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.829 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.829 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.829 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.829 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.829 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899381.978408_225.1", 2020-10-05T12:10:07.830 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.830 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:07.830 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:01.978408731Z", 2020-10-05T12:10:07.830 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.830 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.830 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.830 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.831 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.831 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.831 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:07.831 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.831 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.831 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.831 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.832 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.832 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.832 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.832 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.832 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899381.982368_241.1", 2020-10-05T12:10:07.832 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.832 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:07.832 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:01.982368788Z", 2020-10-05T12:10:07.833 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.833 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.833 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.833 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.833 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.833 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.833 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:07.834 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.834 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.834 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.834 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.834 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.834 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.834 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.835 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.835 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899381.984906_242.1", 2020-10-05T12:10:07.835 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.835 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-19", 2020-10-05T12:10:07.835 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:01.984906741Z", 2020-10-05T12:10:07.835 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.835 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.835 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.836 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.836 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.836 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.836 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_xxeD7TssMyWfSY39I2Qdo-t", 2020-10-05T12:10:07.836 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.836 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.836 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.837 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.837 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.837 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.837 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.837 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.837 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899381.988824_243.1", 2020-10-05T12:10:07.837 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.837 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-19", 2020-10-05T12:10:07.838 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:01.988824875Z", 2020-10-05T12:10:07.838 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.838 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.838 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.838 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.838 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.838 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.839 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_xxeD7TssMyWfSY39I2Qdo-t", 2020-10-05T12:10:07.839 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.839 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.839 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.839 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.839 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.839 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.840 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.840 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.840 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899381.995677_244.1", 2020-10-05T12:10:07.840 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.840 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:07.840 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:01.995677672Z", 2020-10-05T12:10:07.840 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.840 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.841 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:07.841 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.841 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.841 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.841 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:07.841 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.841 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.842 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.842 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.842 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.842 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.842 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.842 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.842 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899382.001389_245.1", 2020-10-05T12:10:07.843 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.843 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:07.843 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:02.001389904Z", 2020-10-05T12:10:07.843 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.843 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.843 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:07.843 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.843 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.844 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.844 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:07.844 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.844 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.844 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.844 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.844 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.845 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.845 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.845 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.845 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899541.302756_246.1", 2020-10-05T12:10:07.845 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.845 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:07.845 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:05:41.302756422Z", 2020-10-05T12:10:07.845 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.846 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.846 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.846 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.846 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.846 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.846 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:07.846 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.847 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.847 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.847 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.847 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.847 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.847 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.847 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.848 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899541.307820_257.1", 2020-10-05T12:10:07.848 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.848 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:07.848 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:05:41.307820582Z", 2020-10-05T12:10:07.848 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.848 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.848 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.848 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.849 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.849 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.849 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:07.849 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.849 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.849 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.850 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.850 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.850 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.850 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.850 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.850 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899541.310387_258.1", 2020-10-05T12:10:07.851 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.851 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20", 2020-10-05T12:10:07.851 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:05:41.310387536Z", 2020-10-05T12:10:07.851 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.851 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.852 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.852 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.852 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.852 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.852 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_aImoYIeVSR4CuPJ5tgqZ62Z", 2020-10-05T12:10:07.853 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.853 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.853 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.853 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.853 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.854 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.854 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.854 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.854 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899541.316365_259.1", 2020-10-05T12:10:07.855 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.855 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20", 2020-10-05T12:10:07.855 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:05:41.316365619Z", 2020-10-05T12:10:07.855 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.855 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.855 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.855 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.855 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.856 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.856 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_aImoYIeVSR4CuPJ5tgqZ62Z", 2020-10-05T12:10:07.856 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.856 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.856 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.856 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.856 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.857 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.857 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.857 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.857 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899545.730156_260.1", 2020-10-05T12:10:07.857 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.857 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:07.857 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:05:45.730156910Z", 2020-10-05T12:10:07.857 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.858 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.858 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:07.858 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.858 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.858 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.858 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:07.858 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.859 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.859 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.859 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.859 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.859 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.859 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.859 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.860 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899545.740215_264.1", 2020-10-05T12:10:07.860 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.860 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:07.860 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:05:45.740215247Z", 2020-10-05T12:10:07.860 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.860 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.860 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:07.860 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.861 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.861 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.861 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:07.861 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.861 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.861 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.861 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.862 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.862 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.862 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.862 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.862 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899605.527412_276.1", 2020-10-05T12:10:07.862 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.862 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:07.862 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:06:45.527412662Z", 2020-10-05T12:10:07.863 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.863 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.863 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:07.863 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.863 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.863 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.863 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:07.864 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:07.864 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.864 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.864 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.864 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.864 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.864 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.865 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.865 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899605.537934_277.1", 2020-10-05T12:10:07.865 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.865 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:07.865 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:06:45.537934497Z", 2020-10-05T12:10:07.865 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.865 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.865 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:07.866 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.866 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.866 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.866 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:07.866 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:07.866 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.866 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.867 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.867 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.867 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.867 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.867 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.867 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.340791_278.1", 2020-10-05T12:10:07.867 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.868 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:07.868 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.340791891Z", 2020-10-05T12:10:07.868 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.868 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.868 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.868 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.868 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.868 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.869 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:07.869 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.869 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.869 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.869 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.869 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.869 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.870 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.870 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.870 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.345737_282.1", 2020-10-05T12:10:07.870 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.870 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:07.870 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.345737029Z", 2020-10-05T12:10:07.870 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.871 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.871 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.871 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.871 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.871 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.871 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:07.871 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.871 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.872 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.872 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.872 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.872 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.872 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.872 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.872 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.348030_283.1", 2020-10-05T12:10:07.873 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.873 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-21", 2020-10-05T12:10:07.873 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.348030701Z", 2020-10-05T12:10:07.873 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.873 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.873 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.873 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.874 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.874 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.874 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_WJ0jiCyt20VpMPgS98Z4nqG", 2020-10-05T12:10:07.874 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.874 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.874 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.874 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.874 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.875 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.875 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.875 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.875 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.352832_284.1", 2020-10-05T12:10:07.875 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.875 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-21", 2020-10-05T12:10:07.875 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.352832690Z", 2020-10-05T12:10:07.876 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.876 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.876 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.876 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.876 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.876 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.876 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_WJ0jiCyt20VpMPgS98Z4nqG", 2020-10-05T12:10:07.876 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.877 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.877 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.877 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.877 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.877 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.877 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.877 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.878 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.383105_285.1", 2020-10-05T12:10:07.878 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.878 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:07.878 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.383105561Z", 2020-10-05T12:10:07.878 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.878 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.878 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.879 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.879 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.879 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.879 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:07.879 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.879 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.879 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.880 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.880 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.880 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.880 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.880 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.880 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.388239_286.1", 2020-10-05T12:10:07.880 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.880 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:07.881 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.388239047Z", 2020-10-05T12:10:07.881 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.881 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.881 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.881 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.881 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.881 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.882 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:07.882 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.882 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.882 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.882 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.882 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.882 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.883 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.883 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.883 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.390789_287.1", 2020-10-05T12:10:07.883 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.883 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-22", 2020-10-05T12:10:07.883 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.390789948Z", 2020-10-05T12:10:07.883 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.883 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.884 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.884 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.884 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.884 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.884 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_0_1hH9wu8fdrjzn6LfnAjui", 2020-10-05T12:10:07.884 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.884 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.885 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.885 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.885 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.885 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.885 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.885 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.885 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.399241_288.1", 2020-10-05T12:10:07.885 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.886 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-22", 2020-10-05T12:10:07.886 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.399241994Z", 2020-10-05T12:10:07.886 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.886 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.886 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.886 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.886 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.887 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.887 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_0_1hH9wu8fdrjzn6LfnAjui", 2020-10-05T12:10:07.887 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.887 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.887 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.887 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.887 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.888 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.888 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.888 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.888 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.452745_289.1", 2020-10-05T12:10:07.888 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.888 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:07.888 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.452745488Z", 2020-10-05T12:10:07.888 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.889 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.889 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.889 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.889 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.889 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.889 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:07.889 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.890 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.890 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.890 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.890 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.890 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.890 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.890 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.891 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.456617_290.1", 2020-10-05T12:10:07.891 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.891 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:07.891 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.456617145Z", 2020-10-05T12:10:07.891 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.891 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.891 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.891 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.892 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.892 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.892 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:07.892 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.892 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.892 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.892 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.893 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.893 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.893 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.893 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.893 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.458367_291.1", 2020-10-05T12:10:07.893 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.893 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-23", 2020-10-05T12:10:07.894 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.458367135Z", 2020-10-05T12:10:07.894 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.894 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.894 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.894 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.894 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.894 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.895 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U97spIGYsVsG6Wu0_S4U1qa", 2020-10-05T12:10:07.895 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.895 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.895 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.895 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.895 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.895 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.895 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.896 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.896 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.461785_292.1", 2020-10-05T12:10:07.896 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.896 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-23", 2020-10-05T12:10:07.896 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.461785134Z", 2020-10-05T12:10:07.896 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.896 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.897 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.897 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.897 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.897 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.897 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U97spIGYsVsG6Wu0_S4U1qa", 2020-10-05T12:10:07.897 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.897 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.897 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.898 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.898 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.898 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.898 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.898 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.898 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.486140_293.1", 2020-10-05T12:10:07.898 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.899 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:07.899 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.486140603Z", 2020-10-05T12:10:07.899 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.899 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.899 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:07.899 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.899 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.900 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.900 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:07.900 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.900 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.900 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.900 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.900 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.900 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.901 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.901 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.901 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.490948_294.1", 2020-10-05T12:10:07.901 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.901 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:07.901 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.490948615Z", 2020-10-05T12:10:07.901 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.902 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.902 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:07.902 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.902 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.902 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.902 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:07.902 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.902 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.903 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.903 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.903 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.903 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.903 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.903 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.903 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.494647_295.1", 2020-10-05T12:10:07.904 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.904 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:07.904 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.494647353Z", 2020-10-05T12:10:07.904 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.904 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.904 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:07.904 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.905 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.905 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.905 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:07.905 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.905 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.905 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.905 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.905 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.906 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.906 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.906 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.906 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.499864_296.1", 2020-10-05T12:10:07.906 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.906 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:07.906 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.499864471Z", 2020-10-05T12:10:07.907 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.907 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.907 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:07.907 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.907 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.907 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.907 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:07.907 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.908 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.908 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.908 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.908 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.908 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.908 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.908 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.909 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.507738_297.1", 2020-10-05T12:10:07.909 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.909 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:07.909 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.507738076Z", 2020-10-05T12:10:07.909 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.909 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.909 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:07.910 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.910 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.910 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.910 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:07.910 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.910 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.910 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.910 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.911 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.911 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.911 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.911 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.911 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.514287_298.1", 2020-10-05T12:10:07.911 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.911 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:07.912 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.514287293Z", 2020-10-05T12:10:07.912 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.912 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.912 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:07.912 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.912 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.912 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.913 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:07.913 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.913 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.913 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.913 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.913 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.913 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.913 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.914 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.914 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.084952_299.1", 2020-10-05T12:10:07.914 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.914 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:07.914 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.084952678Z", 2020-10-05T12:10:07.914 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.914 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.915 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.915 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.915 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.915 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.915 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:07.915 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.915 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.916 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.916 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.916 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.916 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.916 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.916 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.916 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.089798_307.1", 2020-10-05T12:10:07.917 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.917 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:07.917 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.089798521Z", 2020-10-05T12:10:07.917 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.917 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.917 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.917 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.918 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.918 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.918 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:07.918 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.918 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.918 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.918 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.918 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.919 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.919 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.919 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.919 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.091945_308.1", 2020-10-05T12:10:07.919 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.919 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24", 2020-10-05T12:10:07.919 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.091945247Z", 2020-10-05T12:10:07.920 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.920 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.920 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.920 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.920 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.920 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.920 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_d3QvlMaZvFDsG6fmQcvxore", 2020-10-05T12:10:07.921 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.921 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.921 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.921 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.921 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.921 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.921 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.921 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.922 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.096693_309.1", 2020-10-05T12:10:07.922 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.922 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24", 2020-10-05T12:10:07.922 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.096693948Z", 2020-10-05T12:10:07.922 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.922 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.922 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.923 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.923 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.923 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.923 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_d3QvlMaZvFDsG6fmQcvxore", 2020-10-05T12:10:07.923 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.923 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.923 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.924 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.924 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.924 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.924 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.924 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.924 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.119884_310.1", 2020-10-05T12:10:07.924 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.925 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:07.925 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.119884574Z", 2020-10-05T12:10:07.925 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.925 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.925 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.925 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.925 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.925 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.926 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:07.926 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.926 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.926 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.926 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.926 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.926 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.927 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.927 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.927 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.125073_311.1", 2020-10-05T12:10:07.927 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.927 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:07.927 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.125073988Z", 2020-10-05T12:10:07.927 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.928 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.928 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.928 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.928 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.928 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.928 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:07.928 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.928 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.929 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.929 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.929 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.929 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.929 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.929 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.929 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.127106_312.1", 2020-10-05T12:10:07.930 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.930 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25", 2020-10-05T12:10:07.930 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.127106528Z", 2020-10-05T12:10:07.930 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.930 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.930 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.930 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.930 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.931 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.931 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_0GztoLidLt71aeEmYBk2KIv", 2020-10-05T12:10:07.931 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.931 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.931 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.931 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.931 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.932 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.932 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.932 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.932 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.131736_313.1", 2020-10-05T12:10:07.932 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.932 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25", 2020-10-05T12:10:07.932 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.131736717Z", 2020-10-05T12:10:07.932 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.933 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.933 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.933 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.933 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.933 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.933 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_0GztoLidLt71aeEmYBk2KIv", 2020-10-05T12:10:07.933 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.934 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.934 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.934 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.934 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.934 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.934 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.934 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.935 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.176263_314.1", 2020-10-05T12:10:07.935 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.935 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:07.935 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.176263727Z", 2020-10-05T12:10:07.935 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.935 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.935 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.935 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.936 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.936 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.936 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:07.936 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.936 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.936 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.936 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.937 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.937 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.937 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.937 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.937 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.180812_315.1", 2020-10-05T12:10:07.937 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.937 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:07.938 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.180812847Z", 2020-10-05T12:10:07.938 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.938 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.938 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.938 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.938 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.938 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.939 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:07.939 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.939 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.939 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.939 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.939 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.939 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.939 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.940 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.940 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.182989_316.1", 2020-10-05T12:10:07.940 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.940 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26", 2020-10-05T12:10:07.940 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.182989968Z", 2020-10-05T12:10:07.940 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.940 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.941 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.941 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.941 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.941 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.941 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t91eQVT6DZi4rGBjwoymGxg", 2020-10-05T12:10:07.941 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.941 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.942 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.942 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.942 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.942 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.942 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.942 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.942 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.186900_317.1", 2020-10-05T12:10:07.942 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.943 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26", 2020-10-05T12:10:07.943 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.186900962Z", 2020-10-05T12:10:07.943 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.943 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.943 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.943 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.943 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.944 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.944 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t91eQVT6DZi4rGBjwoymGxg", 2020-10-05T12:10:07.944 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.944 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.944 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.944 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.944 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.944 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.945 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.945 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.945 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.207415_318.1", 2020-10-05T12:10:07.945 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.945 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:07.945 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.207415448Z", 2020-10-05T12:10:07.945 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.946 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.946 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:07.946 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.946 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.946 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.946 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:07.946 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.947 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.947 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.947 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.947 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.947 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.947 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.947 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.947 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.212772_319.1", 2020-10-05T12:10:07.948 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.948 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:07.948 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.212772752Z", 2020-10-05T12:10:07.948 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.948 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.948 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:07.948 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.949 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.949 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.949 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:07.949 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.949 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.949 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.949 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.950 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.950 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.950 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.950 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.950 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.216174_320.1", 2020-10-05T12:10:07.950 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.950 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:07.950 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.216174966Z", 2020-10-05T12:10:07.951 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.951 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.951 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:07.951 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.951 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.951 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.951 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:07.952 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:07.952 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.952 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.952 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.952 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.952 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.952 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.952 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.953 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.222896_321.1", 2020-10-05T12:10:07.953 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.953 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:07.953 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.222896035Z", 2020-10-05T12:10:07.953 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.953 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.953 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:07.954 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.954 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.954 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.954 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:07.954 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:07.954 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.954 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.955 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.955 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.955 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.955 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.955 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.955 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.228952_322.1", 2020-10-05T12:10:07.955 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.956 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:07.956 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.228952822Z", 2020-10-05T12:10:07.956 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.956 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.956 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:07.956 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.956 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.956 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.957 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:07.957 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.957 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.957 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.957 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.957 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.959 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.959 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.959 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.959 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.241169_323.1", 2020-10-05T12:10:07.960 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.960 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:07.960 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.241169846Z", 2020-10-05T12:10:07.960 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.960 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.960 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:07.961 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.961 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.961 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.961 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:07.961 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.961 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.961 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.962 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.962 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.962 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.962 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.962 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.962 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.267420_324.1", 2020-10-05T12:10:07.962 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.963 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:07.963 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.267420223Z", 2020-10-05T12:10:07.963 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.963 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.963 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:07.963 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.963 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.963 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.964 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:07.964 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:07.964 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.964 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.964 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.964 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.964 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.965 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.965 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.965 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.272326_325.1", 2020-10-05T12:10:07.965 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.965 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:07.965 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.272326174Z", 2020-10-05T12:10:07.965 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.966 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.966 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:07.966 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.966 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.966 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.966 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:07.966 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:07.967 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.967 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.967 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.967 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.967 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.967 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.967 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.967 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.281362_326.1", 2020-10-05T12:10:07.968 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.968 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:07.968 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.281362477Z", 2020-10-05T12:10:07.968 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.968 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.968 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:07.968 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.969 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.969 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.969 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:07.969 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.969 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.969 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.969 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.970 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.970 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.970 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.970 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.970 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.298750_327.1", 2020-10-05T12:10:07.970 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.970 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:07.970 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.298750857Z", 2020-10-05T12:10:07.971 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.971 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.971 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:07.971 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.971 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.971 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.971 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:07.972 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.972 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.972 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.972 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.972 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.972 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.972 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.973 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.973 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.311388_328.1", 2020-10-05T12:10:07.973 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.973 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:07.973 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.311388336Z", 2020-10-05T12:10:07.973 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.973 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.973 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:07.974 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.974 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.974 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.974 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:07.974 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:07.974 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.974 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.975 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.975 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.975 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.975 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.975 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.975 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.318021_329.1", 2020-10-05T12:10:07.975 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.976 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:07.976 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.318021017Z", 2020-10-05T12:10:07.976 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.976 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.976 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:07.976 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:07.976 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.976 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.977 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:07.977 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:07.977 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.977 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.977 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.977 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.977 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.978 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.978 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.978 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.685537_330.1", 2020-10-05T12:10:07.978 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.978 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:07.978 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.685537275Z", 2020-10-05T12:10:07.978 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.979 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.979 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.979 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.979 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.979 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.979 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:07.979 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.980 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.980 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.980 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.980 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.980 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.980 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.980 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.980 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.689965_338.1", 2020-10-05T12:10:07.981 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.981 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:07.981 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.689965260Z", 2020-10-05T12:10:07.981 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.981 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.981 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.981 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.982 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.982 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.982 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:07.982 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.982 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.982 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.982 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.983 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.983 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.983 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.983 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.983 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.691704_339.1", 2020-10-05T12:10:07.983 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.983 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-27", 2020-10-05T12:10:07.984 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.691704538Z", 2020-10-05T12:10:07.984 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.984 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.984 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.984 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.984 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.984 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.984 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_3ghfMalV8FJvx__fjUkOrTe", 2020-10-05T12:10:07.985 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.985 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.985 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.985 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.985 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.985 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.985 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.986 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.986 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.696863_340.1", 2020-10-05T12:10:07.986 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.986 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-27", 2020-10-05T12:10:07.986 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.696863318Z", 2020-10-05T12:10:07.986 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.986 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.986 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.987 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.987 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.987 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.987 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_3ghfMalV8FJvx__fjUkOrTe", 2020-10-05T12:10:07.987 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.987 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.987 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.988 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.988 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.988 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.988 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.988 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.988 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.724232_341.1", 2020-10-05T12:10:07.988 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.988 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:07.989 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.724232023Z", 2020-10-05T12:10:07.989 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.989 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.989 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.989 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.989 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.989 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.990 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:07.990 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.990 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.990 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.990 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.990 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.990 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.991 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.991 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.991 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.729087_342.1", 2020-10-05T12:10:07.991 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.991 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:07.991 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.729087316Z", 2020-10-05T12:10:07.991 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.991 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.992 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.992 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.992 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.992 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.992 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:07.992 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.992 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.993 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.993 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.993 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.993 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.993 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.993 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.993 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.731113_343.1", 2020-10-05T12:10:07.993 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.994 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-28", 2020-10-05T12:10:07.994 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.731113851Z", 2020-10-05T12:10:07.994 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.994 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.994 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.994 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.994 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.995 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.995 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qZhqLSO2IT-th3DUT4YqnJL", 2020-10-05T12:10:07.995 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.995 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.995 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.995 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:07.995 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.996 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.996 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.996 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.996 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.735226_344.1", 2020-10-05T12:10:07.996 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:07.996 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-28", 2020-10-05T12:10:07.996 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.735226387Z", 2020-10-05T12:10:07.996 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.997 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.997 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:07.997 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:07.997 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.997 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:07.997 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qZhqLSO2IT-th3DUT4YqnJL", 2020-10-05T12:10:07.997 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:07.998 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.998 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:07.998 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:07.998 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.998 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:07.998 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:07.998 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:07.999 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.784620_345.1", 2020-10-05T12:10:07.999 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:07.999 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:07.999 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.784620187Z", 2020-10-05T12:10:07.999 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:07.999 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:07.999 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.000 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.000 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.000 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.000 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:08.000 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.000 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.000 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.001 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.001 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.001 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.001 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.001 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.001 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.790107_346.1", 2020-10-05T12:10:08.001 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.001 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:08.002 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.790107967Z", 2020-10-05T12:10:08.002 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.002 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.002 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.002 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.002 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.002 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.003 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:08.003 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.003 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.003 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.003 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.003 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.003 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.004 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.004 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.004 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.792020_347.1", 2020-10-05T12:10:08.004 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.004 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-29", 2020-10-05T12:10:08.004 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.792020540Z", 2020-10-05T12:10:08.004 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.004 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.005 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.005 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.005 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.005 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.005 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qBLhF76LBUvDFkuAku_lLJs", 2020-10-05T12:10:08.005 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.005 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.006 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.006 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.006 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.006 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.006 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.006 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.006 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.796655_348.1", 2020-10-05T12:10:08.006 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.007 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-29", 2020-10-05T12:10:08.007 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.796655308Z", 2020-10-05T12:10:08.007 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.007 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.007 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.007 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.007 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.008 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.008 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qBLhF76LBUvDFkuAku_lLJs", 2020-10-05T12:10:08.008 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.008 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.008 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.008 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.008 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.008 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.009 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.009 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.009 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.839365_349.1", 2020-10-05T12:10:08.009 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.009 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:08.009 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.839365259Z", 2020-10-05T12:10:08.009 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.010 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.010 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:08.010 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.010 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.010 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.010 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:08.010 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.011 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.011 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.011 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.011 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.011 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.011 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.011 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.012 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.845048_350.1", 2020-10-05T12:10:08.012 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.012 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:08.012 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.845048144Z", 2020-10-05T12:10:08.012 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.012 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.012 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:08.012 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.013 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.013 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.013 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:08.013 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.013 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.013 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.013 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.014 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.014 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.014 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.014 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.014 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.892935_351.1", 2020-10-05T12:10:08.014 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.014 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:08.015 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.892935368Z", 2020-10-05T12:10:08.015 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.015 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.015 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:08.015 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.015 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.016 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.016 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:08.016 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.016 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.016 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.016 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.016 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.016 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.017 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.017 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.017 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.901826_352.1", 2020-10-05T12:10:08.017 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.017 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:08.017 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.901826223Z", 2020-10-05T12:10:08.018 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.018 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.018 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:08.018 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.018 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.018 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.018 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:08.018 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.019 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.019 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.019 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.019 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.019 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.019 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.019 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.020 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.959774_353.1", 2020-10-05T12:10:08.020 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.020 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:08.020 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.959774780Z", 2020-10-05T12:10:08.020 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.020 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.020 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:08.021 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.021 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.021 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.021 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:08.021 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.021 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.021 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.022 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.022 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.022 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.022 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.022 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.022 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.970218_354.1", 2020-10-05T12:10:08.022 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.023 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:08.023 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.970218043Z", 2020-10-05T12:10:08.023 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.023 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.023 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:08.023 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.023 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.024 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.024 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:08.024 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.024 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.024 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.024 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.025 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.025 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.025 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.025 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.025 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.042360_355.1", 2020-10-05T12:10:08.025 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.025 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:08.026 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.042360998Z", 2020-10-05T12:10:08.026 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.026 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.026 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.026 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.026 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.026 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.027 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:08.027 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.027 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.027 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.027 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.027 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.028 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.028 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.028 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.028 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.048194_356.1", 2020-10-05T12:10:08.028 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.028 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:08.028 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.048194819Z", 2020-10-05T12:10:08.029 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.029 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.029 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.030 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.030 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.030 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.030 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:08.030 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.030 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.030 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.031 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.031 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.031 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.031 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.031 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.031 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.053339_357.1", 2020-10-05T12:10:08.032 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.032 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-30", 2020-10-05T12:10:08.032 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.053339803Z", 2020-10-05T12:10:08.032 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.032 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.032 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.032 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.033 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.033 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.033 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_7U7eHcX5CMNoEpAGs_GrGNM", 2020-10-05T12:10:08.033 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.033 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.033 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.033 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.034 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.034 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.034 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.034 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.034 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.061637_358.1", 2020-10-05T12:10:08.034 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.034 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-30", 2020-10-05T12:10:08.035 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.061637328Z", 2020-10-05T12:10:08.035 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.035 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.035 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.035 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.035 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.035 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.036 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_7U7eHcX5CMNoEpAGs_GrGNM", 2020-10-05T12:10:08.036 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.036 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.036 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.036 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.036 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.036 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.037 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.037 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.037 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.082626_359.1", 2020-10-05T12:10:08.037 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.037 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:08.037 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.082626326Z", 2020-10-05T12:10:08.038 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.038 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.038 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.038 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.038 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.038 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.038 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:08.039 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.039 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.039 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.039 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.039 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.039 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.039 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.040 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.040 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.088179_360.1", 2020-10-05T12:10:08.040 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.040 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:08.040 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.088179217Z", 2020-10-05T12:10:08.040 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.041 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.041 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.041 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.041 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.041 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.041 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:08.042 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.042 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.042 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.042 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.042 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.042 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.043 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.043 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.043 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.093155_361.1", 2020-10-05T12:10:08.043 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.043 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-31", 2020-10-05T12:10:08.043 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.093155536Z", 2020-10-05T12:10:08.043 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.044 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.044 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.044 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.044 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.044 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.044 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_dG5Cl_WMxrVmCxRlv_ggf_X", 2020-10-05T12:10:08.044 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.045 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.045 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.045 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.045 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.045 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.045 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.045 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.045 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.100733_362.1", 2020-10-05T12:10:08.046 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.046 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-31", 2020-10-05T12:10:08.046 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.100733753Z", 2020-10-05T12:10:08.046 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.046 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.046 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.046 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.047 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.047 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.047 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_dG5Cl_WMxrVmCxRlv_ggf_X", 2020-10-05T12:10:08.047 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.047 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.047 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.047 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.048 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.048 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.048 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.048 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.048 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.142756_363.1", 2020-10-05T12:10:08.048 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.048 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:08.049 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.142756231Z", 2020-10-05T12:10:08.049 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.049 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.049 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.049 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.049 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.049 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.049 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:08.050 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.050 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.050 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.050 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.050 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.050 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.050 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.051 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.051 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.147332_364.1", 2020-10-05T12:10:08.051 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.051 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:08.051 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.147332504Z", 2020-10-05T12:10:08.051 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.051 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.051 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.052 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.052 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.052 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.052 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:08.052 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.052 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.052 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.053 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.053 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.053 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.053 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.053 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.053 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.149290_365.1", 2020-10-05T12:10:08.053 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.054 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-32", 2020-10-05T12:10:08.054 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.149290141Z", 2020-10-05T12:10:08.054 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.054 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.054 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.054 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.054 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.054 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.055 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_szbUgjaae7_m6uBd5TkL2Ow", 2020-10-05T12:10:08.055 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.055 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.055 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.055 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.055 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.055 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.056 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.056 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.056 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.153116_366.1", 2020-10-05T12:10:08.056 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.056 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-32", 2020-10-05T12:10:08.056 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.153116214Z", 2020-10-05T12:10:08.056 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.057 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.057 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.057 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.057 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.057 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.057 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_szbUgjaae7_m6uBd5TkL2Ow", 2020-10-05T12:10:08.057 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.057 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.058 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.058 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.058 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.058 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.058 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.058 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.058 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.177454_367.1", 2020-10-05T12:10:08.059 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.059 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:08.059 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.177454223Z", 2020-10-05T12:10:08.059 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.059 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.059 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:08.059 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.059 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.060 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.060 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:08.060 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.060 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.060 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.060 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.060 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.061 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.061 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.061 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.061 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.184234_368.1", 2020-10-05T12:10:08.061 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.061 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:08.061 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.184234806Z", 2020-10-05T12:10:08.061 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.062 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.062 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:08.062 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.062 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.062 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.062 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:08.062 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.063 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.063 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.063 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.063 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.063 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.063 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.063 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.064 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.239181_369.1", 2020-10-05T12:10:08.064 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.064 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:08.064 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.239181274Z", 2020-10-05T12:10:08.064 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.064 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.064 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:08.065 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.065 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.065 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.065 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:08.065 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.065 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.065 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.066 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.066 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.066 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.066 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.066 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.066 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.250627_370.1", 2020-10-05T12:10:08.066 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.066 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:08.067 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.250627601Z", 2020-10-05T12:10:08.067 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.067 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.067 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:08.067 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.067 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.067 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.068 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:08.068 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.068 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.068 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.068 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.068 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.068 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.068 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.069 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.069 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.330136_371.1", 2020-10-05T12:10:08.069 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.069 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:08.069 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.330136508Z", 2020-10-05T12:10:08.069 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.069 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.070 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:08.070 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.070 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.070 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.070 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:08.070 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.070 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.071 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.071 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.071 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.071 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.071 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.071 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.071 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.344671_372.1", 2020-10-05T12:10:08.071 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.072 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:08.072 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.344671408Z", 2020-10-05T12:10:08.072 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.072 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.072 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:08.072 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.072 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.073 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.073 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:08.073 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.073 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.073 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.073 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.073 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.074 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.074 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.074 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.074 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.409725_373.1", 2020-10-05T12:10:08.074 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.074 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:08.074 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.409725716Z", 2020-10-05T12:10:08.075 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.075 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.075 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.075 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.075 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.075 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.075 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:08.075 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.076 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.076 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.076 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.076 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.076 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.076 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.076 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.077 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.414399_374.1", 2020-10-05T12:10:08.077 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.077 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:08.077 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.414399267Z", 2020-10-05T12:10:08.077 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.077 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.077 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.078 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.078 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.078 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.078 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:08.078 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.078 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.078 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.078 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.079 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.079 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.079 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.079 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.079 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.416593_375.1", 2020-10-05T12:10:08.079 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.079 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-33", 2020-10-05T12:10:08.080 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.416593573Z", 2020-10-05T12:10:08.080 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.080 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.080 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.080 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.080 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.080 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.081 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EyrR1NPa80nMYyy_aATR-lo", 2020-10-05T12:10:08.081 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.081 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.081 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.081 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.081 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.081 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.082 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.082 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.082 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.422118_376.1", 2020-10-05T12:10:08.082 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.082 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-33", 2020-10-05T12:10:08.082 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.422118088Z", 2020-10-05T12:10:08.082 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.083 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.083 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.083 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.083 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.083 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.083 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EyrR1NPa80nMYyy_aATR-lo", 2020-10-05T12:10:08.083 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.083 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.084 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.084 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.084 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.084 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.084 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.084 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.084 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.457009_377.1", 2020-10-05T12:10:08.085 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.085 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:08.085 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.457009356Z", 2020-10-05T12:10:08.085 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.085 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.085 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.085 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.086 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.086 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.086 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:08.086 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.086 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.086 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.086 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.087 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.087 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.087 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.087 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.087 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.460962_378.1", 2020-10-05T12:10:08.087 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.087 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:08.087 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.460962760Z", 2020-10-05T12:10:08.088 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.088 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.088 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.088 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.088 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.088 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.088 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:08.089 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.089 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.089 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.089 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.089 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.089 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.089 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.090 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.090 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.462754_379.1", 2020-10-05T12:10:08.090 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.090 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-34", 2020-10-05T12:10:08.090 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.462754733Z", 2020-10-05T12:10:08.090 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.090 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.090 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.091 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.091 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.091 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.091 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_aVIFxV-3ngBmVcQFfKjSUBE", 2020-10-05T12:10:08.091 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.091 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.091 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.092 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.092 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.092 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.092 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.092 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.092 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.466366_380.1", 2020-10-05T12:10:08.092 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.092 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-34", 2020-10-05T12:10:08.093 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.466366720Z", 2020-10-05T12:10:08.093 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.093 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.093 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.093 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.093 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.093 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.094 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_aVIFxV-3ngBmVcQFfKjSUBE", 2020-10-05T12:10:08.094 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.094 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.094 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.094 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.094 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.094 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.095 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.095 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.095 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.499953_381.1", 2020-10-05T12:10:08.095 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.095 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:08.095 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.499953363Z", 2020-10-05T12:10:08.095 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.096 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.096 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.096 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.096 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.096 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.096 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:08.096 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.096 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.097 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.097 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.097 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.097 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.097 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.097 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.097 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.504875_382.1", 2020-10-05T12:10:08.098 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.098 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:08.098 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.504875519Z", 2020-10-05T12:10:08.098 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.098 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.098 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.098 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.099 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.099 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.099 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:08.099 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.099 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.099 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.099 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.099 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.100 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.100 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.100 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.100 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.507574_383.1", 2020-10-05T12:10:08.100 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.100 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-35", 2020-10-05T12:10:08.100 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.507574492Z", 2020-10-05T12:10:08.101 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.101 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.101 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.101 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.101 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.101 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.101 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_--X6GvPo7a_vb5l6gavGQUo", 2020-10-05T12:10:08.101 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.102 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.102 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.102 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.102 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.102 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.102 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.102 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.103 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.512697_384.1", 2020-10-05T12:10:08.103 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.103 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-35", 2020-10-05T12:10:08.103 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.512697176Z", 2020-10-05T12:10:08.103 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.103 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.103 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.104 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.104 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.104 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.104 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_--X6GvPo7a_vb5l6gavGQUo", 2020-10-05T12:10:08.104 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.104 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.104 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.105 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.105 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.105 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.105 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.105 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.105 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.538401_385.1", 2020-10-05T12:10:08.105 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.105 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:08.106 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.538401203Z", 2020-10-05T12:10:08.106 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.106 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.106 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:08.106 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.106 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.106 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.107 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:08.107 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.107 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.107 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.107 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.107 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.107 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.108 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.108 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.108 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.544174_386.1", 2020-10-05T12:10:08.108 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.108 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:08.108 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.544174292Z", 2020-10-05T12:10:08.108 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.108 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.109 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:08.109 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.109 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.109 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.109 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:08.109 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.109 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.110 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.110 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.110 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.110 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.110 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.110 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.110 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899667.597394_387.1", 2020-10-05T12:10:08.110 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.111 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:08.111 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:47.597394776Z", 2020-10-05T12:10:08.111 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.111 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.111 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:08.111 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.111 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.112 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.112 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:08.112 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.112 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.112 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.112 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.112 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.112 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.113 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.113 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.113 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899667.608381_388.1", 2020-10-05T12:10:08.113 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.113 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:08.113 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:47.608381219Z", 2020-10-05T12:10:08.113 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.114 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.114 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:08.114 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.114 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.114 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.114 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:08.114 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.115 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.115 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.115 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.115 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.115 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.115 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.115 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.115 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.669772_389.1", 2020-10-05T12:10:08.116 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.116 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:08.116 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.669772427Z", 2020-10-05T12:10:08.116 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.116 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.116 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:08.116 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.117 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.117 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.117 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:08.117 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.117 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.117 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.117 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.118 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.118 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.118 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.118 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.118 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.681403_390.1", 2020-10-05T12:10:08.118 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.118 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:08.118 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.681403105Z", 2020-10-05T12:10:08.119 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.119 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.119 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:08.119 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.119 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.119 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.119 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:08.120 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.120 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.120 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.120 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.120 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.120 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.120 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.121 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.121 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.755317_391.1", 2020-10-05T12:10:08.121 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.121 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-36:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.36", 2020-10-05T12:10:08.121 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.755317269Z", 2020-10-05T12:10:08.121 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.121 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.122 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.122 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.122 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.122 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.122 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_3icl_ECM1V9msMyvu87yxtG", 2020-10-05T12:10:08.122 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.122 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.122 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.123 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.123 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.123 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.123 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.123 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.123 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.760371_392.1", 2020-10-05T12:10:08.123 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.124 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-36:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.36", 2020-10-05T12:10:08.124 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.760371672Z", 2020-10-05T12:10:08.124 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.124 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.124 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.124 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.124 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.125 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.125 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_3icl_ECM1V9msMyvu87yxtG", 2020-10-05T12:10:08.125 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.125 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.125 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.125 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.125 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.125 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.126 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.126 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.126 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.762899_393.1", 2020-10-05T12:10:08.126 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.126 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-36", 2020-10-05T12:10:08.126 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.762899080Z", 2020-10-05T12:10:08.126 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.127 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.127 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.127 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.127 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.127 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.127 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_8WZRY6hDRE8a9myMhYrKAX_", 2020-10-05T12:10:08.127 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.128 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.128 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.128 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.128 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.128 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.128 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.128 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.128 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.767561_394.1", 2020-10-05T12:10:08.129 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.129 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-36", 2020-10-05T12:10:08.129 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.767561731Z", 2020-10-05T12:10:08.129 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.129 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.129 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.129 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.130 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.130 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.130 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_8WZRY6hDRE8a9myMhYrKAX_", 2020-10-05T12:10:08.130 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.130 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.130 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.130 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.131 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.131 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.131 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.131 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.131 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.797969_395.1", 2020-10-05T12:10:08.131 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.131 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-37:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.37", 2020-10-05T12:10:08.132 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.797969247Z", 2020-10-05T12:10:08.132 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.132 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.132 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.132 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.132 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.132 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.133 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rp3Sewj1i--RN9QFC9kTl1R", 2020-10-05T12:10:08.133 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.133 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.133 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.133 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.133 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.133 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.134 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.134 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.134 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.802805_396.1", 2020-10-05T12:10:08.134 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.134 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-37:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.37", 2020-10-05T12:10:08.134 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.802805288Z", 2020-10-05T12:10:08.134 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.135 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.135 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.135 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.135 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.135 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.135 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rp3Sewj1i--RN9QFC9kTl1R", 2020-10-05T12:10:08.135 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.135 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.136 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.136 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.136 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.136 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.136 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.136 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.136 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.804808_397.1", 2020-10-05T12:10:08.137 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.137 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-37", 2020-10-05T12:10:08.137 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.804808204Z", 2020-10-05T12:10:08.137 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.137 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.137 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.137 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.137 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.138 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.138 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_m6h3qoVJUfeAaOYxYpjLCny", 2020-10-05T12:10:08.138 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.138 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.138 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.138 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.138 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.139 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.139 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.139 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.139 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.808515_398.1", 2020-10-05T12:10:08.139 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.139 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-37", 2020-10-05T12:10:08.139 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.808515097Z", 2020-10-05T12:10:08.140 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.140 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.140 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.140 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.140 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.140 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.140 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_m6h3qoVJUfeAaOYxYpjLCny", 2020-10-05T12:10:08.140 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.141 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.141 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.141 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.141 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.141 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.141 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.141 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.142 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.872453_399.1", 2020-10-05T12:10:08.142 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.142 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-38:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.38", 2020-10-05T12:10:08.142 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.872453804Z", 2020-10-05T12:10:08.142 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.142 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.142 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.142 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.143 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.143 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.143 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_-HoKnRhe8TocC-rxrrEt-K9", 2020-10-05T12:10:08.143 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.143 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.143 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.143 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.144 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.144 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.144 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.144 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.144 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.876761_400.1", 2020-10-05T12:10:08.144 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.144 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-38:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.38", 2020-10-05T12:10:08.144 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.876761083Z", 2020-10-05T12:10:08.145 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.145 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.145 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.145 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.145 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.145 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.145 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_-HoKnRhe8TocC-rxrrEt-K9", 2020-10-05T12:10:08.146 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.146 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.146 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.146 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.146 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.146 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.146 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.147 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.147 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.879002_401.1", 2020-10-05T12:10:08.147 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.147 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-38", 2020-10-05T12:10:08.147 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.879002719Z", 2020-10-05T12:10:08.147 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.147 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.147 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.148 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.148 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.148 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.148 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_s0iZkzLPbkOXiRUVThv-a9T", 2020-10-05T12:10:08.148 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.148 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.148 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.149 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.149 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.149 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.149 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.149 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.149 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.888419_402.1", 2020-10-05T12:10:08.149 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.149 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-38", 2020-10-05T12:10:08.150 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.888419542Z", 2020-10-05T12:10:08.150 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.150 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.150 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.150 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.150 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.150 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.151 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_s0iZkzLPbkOXiRUVThv-a9T", 2020-10-05T12:10:08.151 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.151 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.151 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.151 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.151 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.151 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.152 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.152 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.152 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.482263_403.1", 2020-10-05T12:10:08.152 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.152 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-39:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.39", 2020-10-05T12:10:08.152 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.482263867Z", 2020-10-05T12:10:08.152 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.152 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.153 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.153 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.153 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.153 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.153 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_mBr7LUv6iNJJo-p_fWMP8K5", 2020-10-05T12:10:08.153 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.153 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.153 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.154 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.154 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.154 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.154 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.154 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.154 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.486347_405.1", 2020-10-05T12:10:08.154 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.155 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-39:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.39", 2020-10-05T12:10:08.155 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.486347434Z", 2020-10-05T12:10:08.155 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.155 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.155 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.155 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.155 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.156 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.156 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_mBr7LUv6iNJJo-p_fWMP8K5", 2020-10-05T12:10:08.156 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.156 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.156 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.156 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.156 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.156 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.157 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.157 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.157 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.488367_406.1", 2020-10-05T12:10:08.157 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.157 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-39", 2020-10-05T12:10:08.157 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.488367312Z", 2020-10-05T12:10:08.157 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.158 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.158 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.158 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.158 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.158 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.158 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_xFlhJ327xLR_penGucomc8D", 2020-10-05T12:10:08.158 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.159 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.159 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.159 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.159 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.159 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.159 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.159 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.159 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.492419_407.1", 2020-10-05T12:10:08.160 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.160 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-39", 2020-10-05T12:10:08.160 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.492419420Z", 2020-10-05T12:10:08.160 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.160 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.160 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.160 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.161 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.161 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.161 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_xFlhJ327xLR_penGucomc8D", 2020-10-05T12:10:08.161 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.161 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.161 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.161 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.162 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.162 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.162 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.162 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.162 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.523672_408.1", 2020-10-05T12:10:08.162 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.162 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-40:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.40", 2020-10-05T12:10:08.163 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.523672589Z", 2020-10-05T12:10:08.163 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.163 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.163 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.163 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.163 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.163 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.163 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_M4WWBNi5IJ-RWpNAHhcS0lG", 2020-10-05T12:10:08.164 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.164 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.164 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.164 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.164 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.164 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.164 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.165 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.165 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.528666_409.1", 2020-10-05T12:10:08.165 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.165 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-40:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.40", 2020-10-05T12:10:08.165 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.528666589Z", 2020-10-05T12:10:08.165 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.165 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.165 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.166 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.166 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.166 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.166 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_M4WWBNi5IJ-RWpNAHhcS0lG", 2020-10-05T12:10:08.166 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.166 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.166 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.167 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.167 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.167 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.167 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.167 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.167 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.533845_410.1", 2020-10-05T12:10:08.167 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.168 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-40", 2020-10-05T12:10:08.168 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.533845466Z", 2020-10-05T12:10:08.168 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.168 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.168 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.168 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.168 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.168 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.169 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gWvQIgj3cIEvwYjW0hD1OuM", 2020-10-05T12:10:08.169 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.169 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.169 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.169 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.169 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.169 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.170 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.170 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.170 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.541752_411.1", 2020-10-05T12:10:08.170 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.170 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-40", 2020-10-05T12:10:08.170 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.541752331Z", 2020-10-05T12:10:08.170 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.170 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.171 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.171 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.171 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.171 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.171 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gWvQIgj3cIEvwYjW0hD1OuM", 2020-10-05T12:10:08.171 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.171 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.172 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.172 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.172 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.172 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.172 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.172 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.172 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.597447_412.1", 2020-10-05T12:10:08.172 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.173 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-41:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.41", 2020-10-05T12:10:08.173 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.597447087Z", 2020-10-05T12:10:08.173 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.173 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.173 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.173 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.173 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.174 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.174 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_eaDHMmwfm1xaPKhMWupCPOl", 2020-10-05T12:10:08.174 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.174 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.174 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.174 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.174 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.175 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.175 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.175 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.175 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.602294_413.1", 2020-10-05T12:10:08.175 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.175 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-41:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.41", 2020-10-05T12:10:08.175 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.602294636Z", 2020-10-05T12:10:08.175 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.176 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.176 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.176 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.176 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.176 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.176 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_eaDHMmwfm1xaPKhMWupCPOl", 2020-10-05T12:10:08.176 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.177 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.177 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.177 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.177 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.177 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.177 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.177 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.177 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.604098_414.1", 2020-10-05T12:10:08.178 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.178 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-41", 2020-10-05T12:10:08.178 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.604098679Z", 2020-10-05T12:10:08.178 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.178 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.178 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.178 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.179 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.179 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.179 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Qk4kFwtlsplX3FbEXjLvzNg", 2020-10-05T12:10:08.179 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.179 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.179 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.179 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.179 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.180 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.180 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.180 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.180 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.607428_415.1", 2020-10-05T12:10:08.180 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.180 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-41", 2020-10-05T12:10:08.180 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.607428984Z", 2020-10-05T12:10:08.181 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.181 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.181 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.181 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.181 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.181 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.181 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Qk4kFwtlsplX3FbEXjLvzNg", 2020-10-05T12:10:08.182 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.182 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.182 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.182 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.182 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.182 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.182 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.182 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.183 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.309220_45.1", 2020-10-05T12:10:08.183 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.183 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-1:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.1", 2020-10-05T12:10:08.183 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.309220986Z", 2020-10-05T12:10:08.183 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.183 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.183 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.184 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.184 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.184 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.184 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_yW5321q_H3rgrXH_8hp_2oS", 2020-10-05T12:10:08.184 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.184 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.184 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.184 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.185 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.185 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.185 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.185 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.185 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.323188_52.1", 2020-10-05T12:10:08.185 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.185 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-1:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.1", 2020-10-05T12:10:08.186 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.323188619Z", 2020-10-05T12:10:08.186 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.186 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.186 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.186 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.186 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.186 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.187 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_yW5321q_H3rgrXH_8hp_2oS", 2020-10-05T12:10:08.187 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.187 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.187 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.187 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.187 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.187 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.187 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.188 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.188 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.324606_53.1", 2020-10-05T12:10:08.188 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.188 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-1", 2020-10-05T12:10:08.188 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.324606525Z", 2020-10-05T12:10:08.188 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.188 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.189 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.189 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.189 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.189 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.189 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_O5mZZC9qWHtFDZP9jX8TRT7", 2020-10-05T12:10:08.189 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.189 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.189 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.190 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.190 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.190 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.190 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.190 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.190 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.330398_54.1", 2020-10-05T12:10:08.190 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.191 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-1", 2020-10-05T12:10:08.191 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.330398615Z", 2020-10-05T12:10:08.191 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.191 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.191 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.191 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.191 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.191 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.192 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_O5mZZC9qWHtFDZP9jX8TRT7", 2020-10-05T12:10:08.192 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.192 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.192 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.192 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.192 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.192 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.193 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.193 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.193 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.352875_55.1", 2020-10-05T12:10:08.193 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.193 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-2:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.2", 2020-10-05T12:10:08.193 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.352875916Z", 2020-10-05T12:10:08.193 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.193 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.194 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.194 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.194 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.194 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.194 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_jFiFlBW0gJEjys5t9-_iV1V", 2020-10-05T12:10:08.194 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.194 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.195 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.195 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.195 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.195 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.195 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.195 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.195 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.359690_56.1", 2020-10-05T12:10:08.196 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.196 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-2:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.2", 2020-10-05T12:10:08.196 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.359690270Z", 2020-10-05T12:10:08.196 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.196 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.196 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.196 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.196 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.197 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.197 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_jFiFlBW0gJEjys5t9-_iV1V", 2020-10-05T12:10:08.197 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.197 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.197 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.197 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.197 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.198 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.198 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.198 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.198 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.362078_57.1", 2020-10-05T12:10:08.198 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.198 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-2", 2020-10-05T12:10:08.198 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.362078463Z", 2020-10-05T12:10:08.198 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.199 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.199 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.199 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.199 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.199 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.199 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_WwokRaHlmdENZ_Gh_tirmfG", 2020-10-05T12:10:08.199 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.200 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.200 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.200 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.200 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.200 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.200 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.200 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.201 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.372604_58.1", 2020-10-05T12:10:08.201 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.201 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-2", 2020-10-05T12:10:08.201 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.372604328Z", 2020-10-05T12:10:08.201 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.201 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.201 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.201 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.202 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.202 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.202 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_WwokRaHlmdENZ_Gh_tirmfG", 2020-10-05T12:10:08.202 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.202 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.202 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.202 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.203 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.203 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.203 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.203 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.203 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899136.699771_60.1", 2020-10-05T12:10:08.203 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.203 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-3:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.3", 2020-10-05T12:10:08.204 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:56.699771738Z", 2020-10-05T12:10:08.204 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.204 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.204 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.204 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.204 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.204 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.204 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rmwjFru8PLxDCA-VIsNWDx7", 2020-10-05T12:10:08.205 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.205 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.205 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.205 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.205 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.205 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.205 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.206 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.206 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899136.704901_61.1", 2020-10-05T12:10:08.206 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.206 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-3:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.3", 2020-10-05T12:10:08.206 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:56.704901138Z", 2020-10-05T12:10:08.206 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.206 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.207 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.207 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.207 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.207 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.207 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rmwjFru8PLxDCA-VIsNWDx7", 2020-10-05T12:10:08.207 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.207 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.207 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.208 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.208 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.208 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.208 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.208 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.208 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899136.707633_62.1", 2020-10-05T12:10:08.208 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.209 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-3", 2020-10-05T12:10:08.209 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:56.707633249Z", 2020-10-05T12:10:08.209 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.209 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.209 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.209 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.209 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.209 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.210 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Ae2fl6vm7rY1i6OtshHDi2X", 2020-10-05T12:10:08.210 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.210 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.210 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.210 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.210 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.210 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.211 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.211 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.211 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899136.712011_63.1", 2020-10-05T12:10:08.211 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.211 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-3", 2020-10-05T12:10:08.211 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:56.712011683Z", 2020-10-05T12:10:08.211 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.212 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.212 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.212 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.212 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.212 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.212 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Ae2fl6vm7rY1i6OtshHDi2X", 2020-10-05T12:10:08.212 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.212 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.213 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.213 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.213 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.213 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.213 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.213 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.213 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899137.978801_67.1", 2020-10-05T12:10:08.214 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.214 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-4:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.4", 2020-10-05T12:10:08.214 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:57.978801960Z", 2020-10-05T12:10:08.214 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.214 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.214 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.214 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.214 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.215 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.215 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_R9cr1AM7-ROLCvUODxti2Hy", 2020-10-05T12:10:08.215 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.215 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.215 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.215 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.215 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.216 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.216 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.216 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.216 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899137.983575_68.1", 2020-10-05T12:10:08.216 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.216 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-4:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.4", 2020-10-05T12:10:08.216 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:57.983575708Z", 2020-10-05T12:10:08.216 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.217 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.217 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.217 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.217 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.217 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.217 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_R9cr1AM7-ROLCvUODxti2Hy", 2020-10-05T12:10:08.217 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.218 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.218 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.218 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.218 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.218 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.218 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.218 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.219 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899137.985378_69.1", 2020-10-05T12:10:08.219 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.219 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-4", 2020-10-05T12:10:08.219 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:57.985378089Z", 2020-10-05T12:10:08.219 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.219 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.219 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.219 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.220 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.220 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.220 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_L7bOK0Z4V74uuwLURFH192I", 2020-10-05T12:10:08.220 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.220 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.220 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.220 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.221 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.221 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.221 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.221 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.221 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899137.989603_70.1", 2020-10-05T12:10:08.221 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.221 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-4", 2020-10-05T12:10:08.222 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:57.989603894Z", 2020-10-05T12:10:08.222 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.222 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.222 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.222 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.222 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.222 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.222 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_L7bOK0Z4V74uuwLURFH192I", 2020-10-05T12:10:08.223 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.223 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.223 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.223 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.223 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.223 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.223 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.224 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.224 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.008931_71.1", 2020-10-05T12:10:08.224 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.224 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-5:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.5", 2020-10-05T12:10:08.224 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.008931512Z", 2020-10-05T12:10:08.224 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.224 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.225 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.225 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.225 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.225 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.225 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_mFQkTXg1VqZK7t8XsW9miUA", 2020-10-05T12:10:08.225 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.225 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.225 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.226 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.226 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.226 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.226 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.226 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.226 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.013300_72.1", 2020-10-05T12:10:08.226 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.227 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-5:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.5", 2020-10-05T12:10:08.227 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.013300296Z", 2020-10-05T12:10:08.227 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.227 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.227 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.227 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.227 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.228 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.228 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_mFQkTXg1VqZK7t8XsW9miUA", 2020-10-05T12:10:08.228 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.228 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.228 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.228 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.228 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.228 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.229 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.229 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.229 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.015249_73.1", 2020-10-05T12:10:08.229 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.229 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-5", 2020-10-05T12:10:08.229 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.015249875Z", 2020-10-05T12:10:08.229 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.230 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.230 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.230 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.230 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.230 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.230 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_SdAKsFkJizj_YE8B3JhFv3K", 2020-10-05T12:10:08.230 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.230 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.231 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.231 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.231 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.231 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.231 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.231 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.231 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.019329_74.1", 2020-10-05T12:10:08.232 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.232 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-5", 2020-10-05T12:10:08.232 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.019329476Z", 2020-10-05T12:10:08.232 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.232 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.232 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.232 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.232 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.233 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.233 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_SdAKsFkJizj_YE8B3JhFv3K", 2020-10-05T12:10:08.233 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.233 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.233 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.233 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.233 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.234 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.234 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.234 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.234 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.062991_75.1", 2020-10-05T12:10:08.234 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.234 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-6:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.6", 2020-10-05T12:10:08.234 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.062991051Z", 2020-10-05T12:10:08.235 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.235 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.235 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.235 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.235 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.235 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.235 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_h3WoSQnsgDcU-Zg3rO1vbjh", 2020-10-05T12:10:08.235 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.236 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.236 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.236 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.236 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.236 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.236 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.236 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.237 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.067217_76.1", 2020-10-05T12:10:08.237 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.237 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-6:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.6", 2020-10-05T12:10:08.237 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.067217484Z", 2020-10-05T12:10:08.237 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.237 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.237 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.238 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.238 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.238 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.238 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_h3WoSQnsgDcU-Zg3rO1vbjh", 2020-10-05T12:10:08.238 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.238 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.238 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.239 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.239 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.239 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.239 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.239 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.239 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.069962_77.1", 2020-10-05T12:10:08.239 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.239 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-6", 2020-10-05T12:10:08.240 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.069962715Z", 2020-10-05T12:10:08.240 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.240 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.240 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.240 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.240 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.240 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.241 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_au9QcNPZmxYIo3XlQDwiive", 2020-10-05T12:10:08.241 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.241 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.241 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.241 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.241 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.241 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.241 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.242 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.242 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.076875_78.1", 2020-10-05T12:10:08.242 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.242 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-6", 2020-10-05T12:10:08.242 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.076875124Z", 2020-10-05T12:10:08.242 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.242 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.243 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.243 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.243 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.243 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.243 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_au9QcNPZmxYIo3XlQDwiive", 2020-10-05T12:10:08.243 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.243 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.244 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.244 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.244 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.244 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.244 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.244 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.244 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.926594_79.1", 2020-10-05T12:10:08.244 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.245 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-7:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.7", 2020-10-05T12:10:08.245 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.926594218Z", 2020-10-05T12:10:08.245 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.245 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.245 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.245 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.245 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.246 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.246 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cPLQuBKjrWMkd6tqHbbfy0H", 2020-10-05T12:10:08.246 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.246 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.246 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.246 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.246 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.247 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.247 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.247 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.247 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.931290_84.1", 2020-10-05T12:10:08.247 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.247 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-7:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.7", 2020-10-05T12:10:08.247 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.931290785Z", 2020-10-05T12:10:08.247 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.248 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.248 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.248 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.248 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.248 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.248 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cPLQuBKjrWMkd6tqHbbfy0H", 2020-10-05T12:10:08.248 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.249 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.249 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.249 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.249 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.249 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.249 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.249 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.249 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.933342_85.1", 2020-10-05T12:10:08.250 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.250 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-7", 2020-10-05T12:10:08.250 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.933342285Z", 2020-10-05T12:10:08.250 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.250 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.250 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.250 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.251 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.251 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.251 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:08.251 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.251 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.251 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.251 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.251 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.252 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.252 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.252 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.252 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.939592_86.1", 2020-10-05T12:10:08.252 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.252 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-7", 2020-10-05T12:10:08.252 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.939592960Z", 2020-10-05T12:10:08.253 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.253 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.253 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.253 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.253 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.253 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.253 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:08.254 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.254 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.254 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.254 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.254 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.254 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.254 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.254 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.255 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.961360_87.1", 2020-10-05T12:10:08.255 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.255 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-8:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.8", 2020-10-05T12:10:08.255 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.961360327Z", 2020-10-05T12:10:08.255 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.255 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.255 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.256 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.256 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.256 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.256 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_VfDg-vSGbYSY-RkVKPKcS4N", 2020-10-05T12:10:08.256 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.256 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.256 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.256 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.257 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.257 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.257 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.257 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.257 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.966517_88.1", 2020-10-05T12:10:08.257 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.257 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-8:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.8", 2020-10-05T12:10:08.258 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.966517542Z", 2020-10-05T12:10:08.258 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.258 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.258 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.258 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.258 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.258 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.259 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_VfDg-vSGbYSY-RkVKPKcS4N", 2020-10-05T12:10:08.259 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.259 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.259 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.259 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.259 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.259 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.259 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.260 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.260 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.970413_89.1", 2020-10-05T12:10:08.260 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.260 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-8", 2020-10-05T12:10:08.260 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.970413680Z", 2020-10-05T12:10:08.260 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.260 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.261 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.261 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.261 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.261 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.261 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:08.261 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.261 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.261 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.262 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.262 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.262 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.262 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.262 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.262 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.978679_90.1", 2020-10-05T12:10:08.262 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.263 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-8", 2020-10-05T12:10:08.263 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.978679498Z", 2020-10-05T12:10:08.263 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.263 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.263 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.263 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.263 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.263 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.264 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:08.264 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.264 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.264 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.264 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.264 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.264 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.265 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.265 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.265 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899141.016163_91.1", 2020-10-05T12:10:08.265 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.265 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-9:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.9", 2020-10-05T12:10:08.265 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:01.016163231Z", 2020-10-05T12:10:08.265 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.265 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.266 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.266 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.266 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.266 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.266 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Du3Kn9J3DjlCQqjeBWYnZfm", 2020-10-05T12:10:08.266 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.266 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.267 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.267 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.267 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.267 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.267 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.267 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.267 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899141.026253_92.1", 2020-10-05T12:10:08.267 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.268 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-9:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.9", 2020-10-05T12:10:08.268 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:01.026253368Z", 2020-10-05T12:10:08.268 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.268 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.268 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.268 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.268 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.269 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.269 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Du3Kn9J3DjlCQqjeBWYnZfm", 2020-10-05T12:10:08.269 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.269 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.269 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.269 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.269 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.270 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.270 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.270 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.270 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899141.029629_93.1", 2020-10-05T12:10:08.270 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.270 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-9", 2020-10-05T12:10:08.270 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:01.029629977Z", 2020-10-05T12:10:08.270 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.271 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.271 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.271 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.271 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.271 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.271 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:08.271 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.272 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.272 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.272 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:08.272 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.272 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.272 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.272 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.272 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899141.037160_94.1", 2020-10-05T12:10:08.273 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.273 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-9", 2020-10-05T12:10:08.273 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:01.037160652Z", 2020-10-05T12:10:08.273 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.273 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.273 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:08.273 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:08.274 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.274 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.274 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:08.274 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.274 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.274 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.274 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.275 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.275 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.275 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.275 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.275 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899142.364959_95.1", 2020-10-05T12:10:08.275 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.275 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-7", 2020-10-05T12:10:08.275 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.364959162Z", 2020-10-05T12:10:08.276 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.276 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.276 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:08.276 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.276 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.276 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.276 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:08.277 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.277 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.277 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.277 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "remove" 2020-10-05T12:10:08.277 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.277 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.277 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.278 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.278 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899142.371195_98.1", 2020-10-05T12:10:08.278 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.278 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-7", 2020-10-05T12:10:08.278 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.371195860Z", 2020-10-05T12:10:08.278 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.278 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.278 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:08.279 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.279 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.279 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.279 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:08.279 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.279 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.279 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.280 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.280 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.280 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.280 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.280 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.280 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899142.428255_99.1", 2020-10-05T12:10:08.280 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.281 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-8", 2020-10-05T12:10:08.281 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.428255930Z", 2020-10-05T12:10:08.281 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.281 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.281 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:08.281 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.281 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.281 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.282 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:08.282 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.282 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.282 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.282 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "remove" 2020-10-05T12:10:08.282 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.282 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.283 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.283 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.283 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899142.434846_100.1", 2020-10-05T12:10:08.283 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.283 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-8", 2020-10-05T12:10:08.283 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.434846076Z", 2020-10-05T12:10:08.283 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.283 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.284 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:08.284 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.284 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.284 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.284 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:08.284 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.284 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.285 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.285 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.285 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.285 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.285 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.285 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.285 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899142.528196_101.1", 2020-10-05T12:10:08.286 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.286 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-9", 2020-10-05T12:10:08.286 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.528196199Z", 2020-10-05T12:10:08.286 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.286 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.286 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:08.286 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.287 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.287 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.287 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:08.287 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.287 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.287 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.287 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "remove" 2020-10-05T12:10:08.287 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.288 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.288 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.288 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:08.288 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899142.535244_102.1", 2020-10-05T12:10:08.288 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:08.288 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-9", 2020-10-05T12:10:08.288 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244574Z", 2020-10-05T12:10:08.289 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:08.289 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:08.289 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:08.289 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:08.289 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.289 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:08.289 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:08.289 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:08.290 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:08.290 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:08.290 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:08.290 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.290 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.290 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:08.290 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:10:08.292 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:08.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:08.293 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period eb044115-4632-4a42-8790-5052d87ef1c6 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:08.333 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:08.333 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:08.572 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2020-10-05T12:10:08.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.607 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899010.522064_46.1", 2020-10-05T12:10:08.608 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "user", 2020-10-05T12:10:08.608 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw-multisite-test-user", 2020-10-05T12:10:08.608 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.522064827Z", 2020-10-05T12:10:08.608 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.608 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.608 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.609 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_XfLljzuaU2vSQ_l6_rZc8Jd", 2020-10-05T12:10:08.609 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.609 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.609 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.611 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899010.531704_48.1", 2020-10-05T12:10:08.611 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "user", 2020-10-05T12:10:08.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw-multisite-test-user", 2020-10-05T12:10:08.611 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704315Z", 2020-10-05T12:10:08.611 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.612 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.612 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.613 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_XfLljzuaU2vSQ_l6_rZc8Jd", 2020-10-05T12:10:08.613 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.614 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.614 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.616 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.814004_49.1", 2020-10-05T12:10:08.616 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.616 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-10:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.10", 2020-10-05T12:10:08.616 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.814004723Z", 2020-10-05T12:10:08.617 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.617 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.617 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.618 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.618 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_OUeyPbMbUBT7BQCU4es-77f", 2020-10-05T12:10:08.619 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.619 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.619 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.621 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.820735_57.1", 2020-10-05T12:10:08.621 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.621 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-10:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.10", 2020-10-05T12:10:08.621 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.820735262Z", 2020-10-05T12:10:08.622 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.622 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.622 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.622 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.623 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_OUeyPbMbUBT7BQCU4es-77f", 2020-10-05T12:10:08.623 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.624 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.624 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.625 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.824910_58.1", 2020-10-05T12:10:08.625 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.625 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-10", 2020-10-05T12:10:08.626 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.824910635Z", 2020-10-05T12:10:08.626 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.626 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.627 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.627 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.627 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_0Xb0nTNWivrWvWx3oeYmdD5", 2020-10-05T12:10:08.628 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.628 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.628 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.630 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.833730_59.1", 2020-10-05T12:10:08.630 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.630 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-10", 2020-10-05T12:10:08.631 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.833730650Z", 2020-10-05T12:10:08.631 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.631 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.632 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.632 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_0Xb0nTNWivrWvWx3oeYmdD5", 2020-10-05T12:10:08.633 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.633 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.633 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.635 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.857632_61.1", 2020-10-05T12:10:08.635 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.635 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-11:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.11", 2020-10-05T12:10:08.635 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.857632138Z", 2020-10-05T12:10:08.636 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.636 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.636 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.637 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.637 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_v4mkZAXP0-Rav1j3dZSpNti", 2020-10-05T12:10:08.637 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.638 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.638 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.640 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.862394_62.1", 2020-10-05T12:10:08.640 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.640 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-11:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.11", 2020-10-05T12:10:08.640 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.862394648Z", 2020-10-05T12:10:08.641 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.641 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.641 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.642 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.642 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_v4mkZAXP0-Rav1j3dZSpNti", 2020-10-05T12:10:08.642 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.643 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.643 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.644 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.864807_63.1", 2020-10-05T12:10:08.644 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.645 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-11", 2020-10-05T12:10:08.645 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.864807231Z", 2020-10-05T12:10:08.645 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.645 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.645 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.646 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.646 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_L1Lb50oCzKfeW6cLgFCXcoO", 2020-10-05T12:10:08.647 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.647 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.647 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.649 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.872602_64.1", 2020-10-05T12:10:08.649 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.649 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-11", 2020-10-05T12:10:08.649 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.872602240Z", 2020-10-05T12:10:08.650 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.650 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.650 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.651 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_L1Lb50oCzKfeW6cLgFCXcoO", 2020-10-05T12:10:08.651 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.651 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.652 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.652 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.914339_65.1", 2020-10-05T12:10:08.653 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.653 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-12:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.12", 2020-10-05T12:10:08.653 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.914339616Z", 2020-10-05T12:10:08.653 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.653 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.654 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.654 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.654 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_KBFql2QH92IFaRoA6pUczcF", 2020-10-05T12:10:08.655 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.655 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.656 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.657 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.918665_66.1", 2020-10-05T12:10:08.657 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.657 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-12:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.12", 2020-10-05T12:10:08.658 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.918665490Z", 2020-10-05T12:10:08.658 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.658 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.658 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.659 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.659 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_KBFql2QH92IFaRoA6pUczcF", 2020-10-05T12:10:08.660 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.660 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.661 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.662 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.920603_67.1", 2020-10-05T12:10:08.662 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.663 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-12", 2020-10-05T12:10:08.663 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.920603439Z", 2020-10-05T12:10:08.663 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.663 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.664 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.664 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.665 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.665 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_TSIbo46j-8sw-hblvAeS41m", 2020-10-05T12:10:08.665 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.666 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.666 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.667 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.924911_68.1", 2020-10-05T12:10:08.668 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.668 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-12", 2020-10-05T12:10:08.668 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.924911466Z", 2020-10-05T12:10:08.668 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.669 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.669 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.669 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.670 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.670 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_TSIbo46j-8sw-hblvAeS41m", 2020-10-05T12:10:08.670 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.671 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.671 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.673 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.705730_167.1", 2020-10-05T12:10:08.673 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.673 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-13:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.13", 2020-10-05T12:10:08.673 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.705730871Z", 2020-10-05T12:10:08.674 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.674 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.674 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.675 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.675 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.675 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_fKSRurQRBwqim7c5GEU0PUo", 2020-10-05T12:10:08.676 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.676 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.676 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.677 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.709947_170.1", 2020-10-05T12:10:08.677 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.677 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-13:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.13", 2020-10-05T12:10:08.677 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.709947223Z", 2020-10-05T12:10:08.677 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.677 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.678 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.678 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.678 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.678 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_fKSRurQRBwqim7c5GEU0PUo", 2020-10-05T12:10:08.678 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.679 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.679 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.679 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.711830_171.1", 2020-10-05T12:10:08.680 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.680 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-13", 2020-10-05T12:10:08.680 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.711830069Z", 2020-10-05T12:10:08.680 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.680 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.680 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.680 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.681 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_6qCjZsmNHmFw8bpyRgfhvgp", 2020-10-05T12:10:08.681 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.681 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.681 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.682 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.715644_172.1", 2020-10-05T12:10:08.682 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.682 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-13", 2020-10-05T12:10:08.682 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.715644136Z", 2020-10-05T12:10:08.683 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.683 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.683 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.683 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.683 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.683 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_6qCjZsmNHmFw8bpyRgfhvgp", 2020-10-05T12:10:08.684 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.684 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.684 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.685 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.735814_173.1", 2020-10-05T12:10:08.685 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.685 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-14:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.14", 2020-10-05T12:10:08.685 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.735814205Z", 2020-10-05T12:10:08.685 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.685 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.685 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.686 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.686 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.686 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_4DMFEEdE_URAKSdIzf9-FJr", 2020-10-05T12:10:08.686 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.686 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.687 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.687 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.740366_174.1", 2020-10-05T12:10:08.687 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.687 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-14:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.14", 2020-10-05T12:10:08.688 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.740366438Z", 2020-10-05T12:10:08.688 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.688 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.688 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.688 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.688 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.689 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_4DMFEEdE_URAKSdIzf9-FJr", 2020-10-05T12:10:08.689 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.689 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.689 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.690 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.743243_175.1", 2020-10-05T12:10:08.690 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.690 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-14", 2020-10-05T12:10:08.690 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.743243682Z", 2020-10-05T12:10:08.690 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.690 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.691 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.691 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.691 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.691 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UIQfkMuDK3qo2qDganeuBr3", 2020-10-05T12:10:08.691 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.692 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.692 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.692 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.748706_176.1", 2020-10-05T12:10:08.693 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.693 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-14", 2020-10-05T12:10:08.693 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.748706141Z", 2020-10-05T12:10:08.693 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.693 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.693 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.694 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.694 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UIQfkMuDK3qo2qDganeuBr3", 2020-10-05T12:10:08.694 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.694 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.694 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.695 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.800203_177.1", 2020-10-05T12:10:08.695 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.695 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-15:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.15", 2020-10-05T12:10:08.695 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.800203983Z", 2020-10-05T12:10:08.696 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.696 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.696 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.696 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_3-e1Ii4K_TT4M1zQxUiOW6q", 2020-10-05T12:10:08.696 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.697 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.697 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.698 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.807858_178.1", 2020-10-05T12:10:08.698 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.698 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-15:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.15", 2020-10-05T12:10:08.698 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.807858930Z", 2020-10-05T12:10:08.698 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.698 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.698 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.698 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.699 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_3-e1Ii4K_TT4M1zQxUiOW6q", 2020-10-05T12:10:08.699 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.699 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.699 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.700 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.810402_179.1", 2020-10-05T12:10:08.700 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.700 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-15", 2020-10-05T12:10:08.701 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.810402748Z", 2020-10-05T12:10:08.701 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.701 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.701 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.701 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pIn_cx-kgGjdDSA4gCi-AHV", 2020-10-05T12:10:08.702 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.702 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.702 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.703 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.815329_180.1", 2020-10-05T12:10:08.703 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.703 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-15", 2020-10-05T12:10:08.703 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.815329634Z", 2020-10-05T12:10:08.703 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.703 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.704 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.704 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.704 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.704 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pIn_cx-kgGjdDSA4gCi-AHV", 2020-10-05T12:10:08.704 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.704 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.705 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.705 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.087142_206.1", 2020-10-05T12:10:08.705 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.706 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:08.706 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.087142258Z", 2020-10-05T12:10:08.706 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.706 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.706 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.706 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.706 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.707 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:08.707 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.707 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.707 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.708 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.092441_208.1", 2020-10-05T12:10:08.708 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.708 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:08.708 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.092441445Z", 2020-10-05T12:10:08.708 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.709 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.709 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.709 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:08.709 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.710 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.710 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.710 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.094590_209.1", 2020-10-05T12:10:08.711 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.711 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-16", 2020-10-05T12:10:08.711 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.094590609Z", 2020-10-05T12:10:08.711 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.711 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.711 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.711 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.712 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_19VzZjSbKDNxSKagtOnJpeP", 2020-10-05T12:10:08.712 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.712 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.712 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.713 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.098781_210.1", 2020-10-05T12:10:08.713 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.713 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-16", 2020-10-05T12:10:08.713 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.098781140Z", 2020-10-05T12:10:08.714 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.714 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.714 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.714 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_19VzZjSbKDNxSKagtOnJpeP", 2020-10-05T12:10:08.715 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.715 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.715 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.716 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.123698_211.1", 2020-10-05T12:10:08.716 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.716 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:08.716 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.123698075Z", 2020-10-05T12:10:08.716 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.716 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.716 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.717 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.717 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.717 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:08.717 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.717 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.717 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.718 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.128567_212.1", 2020-10-05T12:10:08.718 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.718 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:08.719 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.128567062Z", 2020-10-05T12:10:08.719 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.719 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.719 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.719 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.719 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.720 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:08.720 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.720 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.720 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.721 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.130568_213.1", 2020-10-05T12:10:08.721 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.721 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-17", 2020-10-05T12:10:08.721 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.130568070Z", 2020-10-05T12:10:08.721 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.721 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.722 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.722 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q4C4WlcctcpJbNFl9-F-oBc", 2020-10-05T12:10:08.722 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.723 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.723 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.723 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.134679_214.1", 2020-10-05T12:10:08.723 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.724 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-17", 2020-10-05T12:10:08.724 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.134679951Z", 2020-10-05T12:10:08.724 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.724 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.724 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.724 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.725 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.725 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q4C4WlcctcpJbNFl9-F-oBc", 2020-10-05T12:10:08.725 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.725 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.725 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.726 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.176345_215.1", 2020-10-05T12:10:08.726 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.726 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:08.726 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.176345246Z", 2020-10-05T12:10:08.726 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.727 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.727 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.727 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:08.727 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.728 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.728 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.729 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.181063_216.1", 2020-10-05T12:10:08.729 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.729 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:08.729 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.181063933Z", 2020-10-05T12:10:08.729 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.729 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.729 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.730 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.730 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.730 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:08.730 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.730 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.731 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.731 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.183114_217.1", 2020-10-05T12:10:08.731 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.732 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-18", 2020-10-05T12:10:08.732 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.183114762Z", 2020-10-05T12:10:08.732 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.732 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.732 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.732 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.733 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.733 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rsmMMhH9J_A9xJxzE-ZmVue", 2020-10-05T12:10:08.733 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.733 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.733 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.733 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.734 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.187062_218.1", 2020-10-05T12:10:08.734 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.734 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-18", 2020-10-05T12:10:08.734 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.187062554Z", 2020-10-05T12:10:08.735 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.735 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.735 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.735 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rsmMMhH9J_A9xJxzE-ZmVue", 2020-10-05T12:10:08.735 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.736 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.736 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.737 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.209336_219.1", 2020-10-05T12:10:08.737 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.737 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:08.737 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.209336756Z", 2020-10-05T12:10:08.737 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.737 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.737 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:08.738 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.738 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.738 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:08.738 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.738 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.738 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.739 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.221609_220.1", 2020-10-05T12:10:08.739 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.739 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:08.740 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.221609923Z", 2020-10-05T12:10:08.740 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.740 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.740 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:08.740 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.740 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.740 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:08.741 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.741 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.741 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.742 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.229421_221.1", 2020-10-05T12:10:08.742 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.742 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:08.742 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.229421160Z", 2020-10-05T12:10:08.742 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.742 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.743 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:08.743 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.743 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.743 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:08.743 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.743 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.744 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.744 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.744 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.744 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.237256_222.1", 2020-10-05T12:10:08.744 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.745 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:08.745 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.237256353Z", 2020-10-05T12:10:08.745 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.745 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.745 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:08.745 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.745 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.746 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:08.746 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.746 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.746 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.747 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.249534_223.1", 2020-10-05T12:10:08.747 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.747 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:08.747 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.249534958Z", 2020-10-05T12:10:08.747 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.748 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.748 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:08.748 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.748 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.748 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:08.748 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.749 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.749 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.749 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.261322_224.1", 2020-10-05T12:10:08.750 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.750 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:08.750 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.261322106Z", 2020-10-05T12:10:08.750 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.750 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.750 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:08.750 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.751 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:08.751 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.751 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.751 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.752 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899381.978408_225.1", 2020-10-05T12:10:08.752 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.752 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:08.752 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:01.978408731Z", 2020-10-05T12:10:08.753 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.753 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.753 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.753 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.753 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.753 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:08.753 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.754 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.754 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.755 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899381.982368_241.1", 2020-10-05T12:10:08.755 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.755 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:08.755 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:01.982368788Z", 2020-10-05T12:10:08.755 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.755 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.755 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.756 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.756 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:08.756 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.756 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.756 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.757 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899381.984906_242.1", 2020-10-05T12:10:08.757 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.757 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-19", 2020-10-05T12:10:08.757 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:01.984906741Z", 2020-10-05T12:10:08.758 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.758 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.758 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.758 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.758 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.758 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_xxeD7TssMyWfSY39I2Qdo-t", 2020-10-05T12:10:08.759 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.759 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.759 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.760 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899381.988824_243.1", 2020-10-05T12:10:08.760 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.760 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-19", 2020-10-05T12:10:08.760 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:01.988824875Z", 2020-10-05T12:10:08.760 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.760 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.761 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.761 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.761 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.761 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_xxeD7TssMyWfSY39I2Qdo-t", 2020-10-05T12:10:08.761 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.761 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.762 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.762 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899381.995677_244.1", 2020-10-05T12:10:08.762 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.763 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:08.763 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:01.995677672Z", 2020-10-05T12:10:08.763 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.763 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.763 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:08.763 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.763 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.765 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899382.001389_245.1", 2020-10-05T12:10:08.765 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.765 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:08.765 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:02.001389904Z", 2020-10-05T12:10:08.765 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.767 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.767 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.767 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899541.302756_246.1", 2020-10-05T12:10:08.768 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.768 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:08.768 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:41.302756422Z", 2020-10-05T12:10:08.768 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.768 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.768 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.768 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.769 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:08.769 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.769 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.769 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.770 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899541.307820_257.1", 2020-10-05T12:10:08.770 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.770 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:08.770 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:41.307820582Z", 2020-10-05T12:10:08.771 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.771 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.771 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.771 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:08.771 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.772 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.772 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.773 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899541.310387_258.1", 2020-10-05T12:10:08.773 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.773 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20", 2020-10-05T12:10:08.773 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:41.310387536Z", 2020-10-05T12:10:08.773 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.773 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.773 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.773 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.774 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_aImoYIeVSR4CuPJ5tgqZ62Z", 2020-10-05T12:10:08.774 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.774 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.774 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.775 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899541.316365_259.1", 2020-10-05T12:10:08.775 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.775 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20", 2020-10-05T12:10:08.776 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:41.316365619Z", 2020-10-05T12:10:08.776 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.776 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.776 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.776 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_aImoYIeVSR4CuPJ5tgqZ62Z", 2020-10-05T12:10:08.777 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.777 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.777 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.778 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899545.730156_260.1", 2020-10-05T12:10:08.778 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.778 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:08.778 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:45.730156910Z", 2020-10-05T12:10:08.778 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.778 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:08.779 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.779 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.779 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:08.779 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.779 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.780 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.780 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899545.740215_264.1", 2020-10-05T12:10:08.780 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.781 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:08.781 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:45.740215247Z", 2020-10-05T12:10:08.781 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.781 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.781 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:08.781 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.781 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:08.782 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.782 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.782 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.783 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899605.527412_276.1", 2020-10-05T12:10:08.783 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.783 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:08.783 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:06:45.527412662Z", 2020-10-05T12:10:08.783 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.784 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.784 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:08.784 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.784 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.784 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:08.784 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:08.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.785 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.785 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.785 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899605.537934_277.1", 2020-10-05T12:10:08.786 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.786 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:08.786 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:06:45.537934497Z", 2020-10-05T12:10:08.786 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.786 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.786 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:08.786 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.787 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.787 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:08.787 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:08.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.787 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.787 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.788 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.340791_278.1", 2020-10-05T12:10:08.788 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.788 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:08.788 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.340791891Z", 2020-10-05T12:10:08.788 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.789 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.789 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.789 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.789 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.789 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:08.789 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.790 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.790 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.791 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.345737_282.1", 2020-10-05T12:10:08.791 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.791 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:08.791 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.345737029Z", 2020-10-05T12:10:08.791 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.791 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.791 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.791 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.792 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.792 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:08.792 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.792 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.792 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.793 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.348030_283.1", 2020-10-05T12:10:08.793 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.793 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-21", 2020-10-05T12:10:08.794 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.348030701Z", 2020-10-05T12:10:08.794 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.794 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.794 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.794 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.794 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.794 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_WJ0jiCyt20VpMPgS98Z4nqG", 2020-10-05T12:10:08.795 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.795 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.795 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.796 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.352832_284.1", 2020-10-05T12:10:08.796 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.796 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-21", 2020-10-05T12:10:08.796 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.352832690Z", 2020-10-05T12:10:08.796 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.796 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.797 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.797 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.797 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.797 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_WJ0jiCyt20VpMPgS98Z4nqG", 2020-10-05T12:10:08.797 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.797 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.798 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.798 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.383105_285.1", 2020-10-05T12:10:08.798 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.799 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:08.799 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.383105561Z", 2020-10-05T12:10:08.799 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.799 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.388239_286.1", 2020-10-05T12:10:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.388239047Z", 2020-10-05T12:10:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.390789_287.1", 2020-10-05T12:10:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-22", 2020-10-05T12:10:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.390789948Z", 2020-10-05T12:10:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_0_1hH9wu8fdrjzn6LfnAjui", 2020-10-05T12:10:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.399241_288.1", 2020-10-05T12:10:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-22", 2020-10-05T12:10:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.399241994Z", 2020-10-05T12:10:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_0_1hH9wu8fdrjzn6LfnAjui", 2020-10-05T12:10:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.452745_289.1", 2020-10-05T12:10:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.452745488Z", 2020-10-05T12:10:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.456617_290.1", 2020-10-05T12:10:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.456617145Z", 2020-10-05T12:10:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.458367_291.1", 2020-10-05T12:10:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-23", 2020-10-05T12:10:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.458367135Z", 2020-10-05T12:10:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U97spIGYsVsG6Wu0_S4U1qa", 2020-10-05T12:10:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.461785_292.1", 2020-10-05T12:10:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-23", 2020-10-05T12:10:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.461785134Z", 2020-10-05T12:10:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U97spIGYsVsG6Wu0_S4U1qa", 2020-10-05T12:10:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.486140_293.1", 2020-10-05T12:10:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.486140603Z", 2020-10-05T12:10:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.490948_294.1", 2020-10-05T12:10:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.490948615Z", 2020-10-05T12:10:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.494647_295.1", 2020-10-05T12:10:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.494647353Z", 2020-10-05T12:10:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.499864_296.1", 2020-10-05T12:10:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.499864471Z", 2020-10-05T12:10:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.507738_297.1", 2020-10-05T12:10:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.507738076Z", 2020-10-05T12:10:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.514287_298.1", 2020-10-05T12:10:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.514287293Z", 2020-10-05T12:10:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.084952_299.1", 2020-10-05T12:10:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.084952678Z", 2020-10-05T12:10:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.089798_307.1", 2020-10-05T12:10:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.089798521Z", 2020-10-05T12:10:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.091945_308.1", 2020-10-05T12:10:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24", 2020-10-05T12:10:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.091945247Z", 2020-10-05T12:10:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_d3QvlMaZvFDsG6fmQcvxore", 2020-10-05T12:10:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.848 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.096693_309.1", 2020-10-05T12:10:08.848 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.848 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24", 2020-10-05T12:10:08.848 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.096693948Z", 2020-10-05T12:10:08.848 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.848 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_d3QvlMaZvFDsG6fmQcvxore", 2020-10-05T12:10:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.119884_310.1", 2020-10-05T12:10:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.119884574Z", 2020-10-05T12:10:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.125073_311.1", 2020-10-05T12:10:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.125073988Z", 2020-10-05T12:10:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.127106_312.1", 2020-10-05T12:10:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25", 2020-10-05T12:10:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.127106528Z", 2020-10-05T12:10:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_0GztoLidLt71aeEmYBk2KIv", 2020-10-05T12:10:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.131736_313.1", 2020-10-05T12:10:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25", 2020-10-05T12:10:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.131736717Z", 2020-10-05T12:10:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_0GztoLidLt71aeEmYBk2KIv", 2020-10-05T12:10:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.176263_314.1", 2020-10-05T12:10:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.176263727Z", 2020-10-05T12:10:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.180812_315.1", 2020-10-05T12:10:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.180812847Z", 2020-10-05T12:10:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.182989_316.1", 2020-10-05T12:10:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26", 2020-10-05T12:10:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.182989968Z", 2020-10-05T12:10:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t91eQVT6DZi4rGBjwoymGxg", 2020-10-05T12:10:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.186900_317.1", 2020-10-05T12:10:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26", 2020-10-05T12:10:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.186900962Z", 2020-10-05T12:10:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t91eQVT6DZi4rGBjwoymGxg", 2020-10-05T12:10:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.207415_318.1", 2020-10-05T12:10:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.207415448Z", 2020-10-05T12:10:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.212772_319.1", 2020-10-05T12:10:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.212772752Z", 2020-10-05T12:10:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.216174_320.1", 2020-10-05T12:10:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.216174966Z", 2020-10-05T12:10:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.222896_321.1", 2020-10-05T12:10:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.222896035Z", 2020-10-05T12:10:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.228952_322.1", 2020-10-05T12:10:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.228952822Z", 2020-10-05T12:10:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.241169_323.1", 2020-10-05T12:10:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.241169846Z", 2020-10-05T12:10:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.267420_324.1", 2020-10-05T12:10:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.267420223Z", 2020-10-05T12:10:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.272326_325.1", 2020-10-05T12:10:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.272326174Z", 2020-10-05T12:10:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.281362_326.1", 2020-10-05T12:10:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.281362477Z", 2020-10-05T12:10:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.298750_327.1", 2020-10-05T12:10:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.298750857Z", 2020-10-05T12:10:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.311388_328.1", 2020-10-05T12:10:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.311388336Z", 2020-10-05T12:10:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.318021_329.1", 2020-10-05T12:10:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.318021017Z", 2020-10-05T12:10:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.685537_330.1", 2020-10-05T12:10:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.685537275Z", 2020-10-05T12:10:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.689965_338.1", 2020-10-05T12:10:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.689965260Z", 2020-10-05T12:10:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.691704_339.1", 2020-10-05T12:10:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-27", 2020-10-05T12:10:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.691704538Z", 2020-10-05T12:10:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_3ghfMalV8FJvx__fjUkOrTe", 2020-10-05T12:10:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.909 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.909 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.909 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.696863_340.1", 2020-10-05T12:10:08.910 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.910 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-27", 2020-10-05T12:10:08.910 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.696863318Z", 2020-10-05T12:10:08.910 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.910 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.910 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.910 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.911 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.911 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_3ghfMalV8FJvx__fjUkOrTe", 2020-10-05T12:10:08.911 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.911 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.911 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.912 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.724232_341.1", 2020-10-05T12:10:08.912 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.912 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:08.912 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.724232023Z", 2020-10-05T12:10:08.913 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.913 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.913 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.913 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:08.914 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.914 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.914 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.915 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.729087_342.1", 2020-10-05T12:10:08.915 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.915 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:08.915 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.729087316Z", 2020-10-05T12:10:08.915 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.915 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.915 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.916 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.916 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:08.916 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.916 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.917 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.917 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.731113_343.1", 2020-10-05T12:10:08.917 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.917 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-28", 2020-10-05T12:10:08.918 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.731113851Z", 2020-10-05T12:10:08.918 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.918 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.918 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.918 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.918 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.919 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qZhqLSO2IT-th3DUT4YqnJL", 2020-10-05T12:10:08.919 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.919 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.919 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.920 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.735226_344.1", 2020-10-05T12:10:08.920 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.920 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-28", 2020-10-05T12:10:08.920 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.735226387Z", 2020-10-05T12:10:08.920 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.920 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.921 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.921 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.921 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.921 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qZhqLSO2IT-th3DUT4YqnJL", 2020-10-05T12:10:08.921 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.922 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.922 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.922 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.784620_345.1", 2020-10-05T12:10:08.923 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.923 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:08.923 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.784620187Z", 2020-10-05T12:10:08.923 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.923 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.923 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.923 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.790107_346.1", 2020-10-05T12:10:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:08.925 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.790107967Z", 2020-10-05T12:10:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.926 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.792020_347.1", 2020-10-05T12:10:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-29", 2020-10-05T12:10:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.792020540Z", 2020-10-05T12:10:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.928 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qBLhF76LBUvDFkuAku_lLJs", 2020-10-05T12:10:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.929 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.796655_348.1", 2020-10-05T12:10:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.930 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-29", 2020-10-05T12:10:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.796655308Z", 2020-10-05T12:10:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.931 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qBLhF76LBUvDFkuAku_lLJs", 2020-10-05T12:10:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.839365_349.1", 2020-10-05T12:10:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.839365259Z", 2020-10-05T12:10:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.933 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.934 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.845048_350.1", 2020-10-05T12:10:08.935 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.845048144Z", 2020-10-05T12:10:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.936 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.892935_351.1", 2020-10-05T12:10:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.892935368Z", 2020-10-05T12:10:08.938 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.940 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.901826_352.1", 2020-10-05T12:10:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.901826223Z", 2020-10-05T12:10:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.959774_353.1", 2020-10-05T12:10:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.943 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.959774780Z", 2020-10-05T12:10:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.970218_354.1", 2020-10-05T12:10:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.970218043Z", 2020-10-05T12:10:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.946 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.947 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.042360_355.1", 2020-10-05T12:10:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.948 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.042360998Z", 2020-10-05T12:10:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.949 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.048194_356.1", 2020-10-05T12:10:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.048194819Z", 2020-10-05T12:10:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.951 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.053339_357.1", 2020-10-05T12:10:08.953 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-30", 2020-10-05T12:10:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.053339803Z", 2020-10-05T12:10:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_7U7eHcX5CMNoEpAGs_GrGNM", 2020-10-05T12:10:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.061637_358.1", 2020-10-05T12:10:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-30", 2020-10-05T12:10:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.061637328Z", 2020-10-05T12:10:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_7U7eHcX5CMNoEpAGs_GrGNM", 2020-10-05T12:10:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.958 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.082626_359.1", 2020-10-05T12:10:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.082626326Z", 2020-10-05T12:10:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.088179_360.1", 2020-10-05T12:10:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:08.961 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.088179217Z", 2020-10-05T12:10:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.093155_361.1", 2020-10-05T12:10:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-31", 2020-10-05T12:10:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.093155536Z", 2020-10-05T12:10:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_dG5Cl_WMxrVmCxRlv_ggf_X", 2020-10-05T12:10:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.100733_362.1", 2020-10-05T12:10:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.966 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-31", 2020-10-05T12:10:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.100733753Z", 2020-10-05T12:10:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.967 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_dG5Cl_WMxrVmCxRlv_ggf_X", 2020-10-05T12:10:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.142756_363.1", 2020-10-05T12:10:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.142756231Z", 2020-10-05T12:10:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.969 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.970 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.147332_364.1", 2020-10-05T12:10:08.971 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.147332504Z", 2020-10-05T12:10:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.972 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.149290_365.1", 2020-10-05T12:10:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-32", 2020-10-05T12:10:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.149290141Z", 2020-10-05T12:10:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.974 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.975 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.975 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_szbUgjaae7_m6uBd5TkL2Ow", 2020-10-05T12:10:08.975 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.153116_366.1", 2020-10-05T12:10:08.976 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-32", 2020-10-05T12:10:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.153116214Z", 2020-10-05T12:10:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_szbUgjaae7_m6uBd5TkL2Ow", 2020-10-05T12:10:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.177454_367.1", 2020-10-05T12:10:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.177454223Z", 2020-10-05T12:10:08.979 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.981 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.184234_368.1", 2020-10-05T12:10:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.184234806Z", 2020-10-05T12:10:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:08.982 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.239181_369.1", 2020-10-05T12:10:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:08.984 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.239181274Z", 2020-10-05T12:10:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:08.985 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.250627_370.1", 2020-10-05T12:10:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.250627601Z", 2020-10-05T12:10:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:08.987 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.988 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.330136_371.1", 2020-10-05T12:10:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.989 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.330136508Z", 2020-10-05T12:10:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.344671_372.1", 2020-10-05T12:10:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.344671408Z", 2020-10-05T12:10:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.992 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.409725_373.1", 2020-10-05T12:10:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.994 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.409725716Z", 2020-10-05T12:10:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.995 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.414399_374.1", 2020-10-05T12:10:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.414399267Z", 2020-10-05T12:10:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:08.997 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:08.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.416593_375.1", 2020-10-05T12:10:08.999 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-33", 2020-10-05T12:10:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.416593573Z", 2020-10-05T12:10:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EyrR1NPa80nMYyy_aATR-lo", 2020-10-05T12:10:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.422118_376.1", 2020-10-05T12:10:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-33", 2020-10-05T12:10:09.002 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.422118088Z", 2020-10-05T12:10:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.003 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EyrR1NPa80nMYyy_aATR-lo", 2020-10-05T12:10:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.457009_377.1", 2020-10-05T12:10:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.457009356Z", 2020-10-05T12:10:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.005 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.006 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.460962_378.1", 2020-10-05T12:10:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.007 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.460962760Z", 2020-10-05T12:10:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.008 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.462754_379.1", 2020-10-05T12:10:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-34", 2020-10-05T12:10:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.462754733Z", 2020-10-05T12:10:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.010 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_aVIFxV-3ngBmVcQFfKjSUBE", 2020-10-05T12:10:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.011 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.466366_380.1", 2020-10-05T12:10:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-34", 2020-10-05T12:10:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.466366720Z", 2020-10-05T12:10:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.014 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.014 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_aVIFxV-3ngBmVcQFfKjSUBE", 2020-10-05T12:10:09.014 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.014 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.014 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.015 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.499953_381.1", 2020-10-05T12:10:09.015 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.015 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:09.015 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.499953363Z", 2020-10-05T12:10:09.015 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.016 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.016 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.016 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.016 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.016 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:09.016 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.017 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.017 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.017 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.017 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.018 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.504875_382.1", 2020-10-05T12:10:09.018 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.018 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:09.018 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.504875519Z", 2020-10-05T12:10:09.018 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.018 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.018 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.018 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.019 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.019 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:09.019 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.019 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.019 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.020 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.507574_383.1", 2020-10-05T12:10:09.020 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.020 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-35", 2020-10-05T12:10:09.021 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.507574492Z", 2020-10-05T12:10:09.021 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.021 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.021 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.021 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.021 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.021 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_--X6GvPo7a_vb5l6gavGQUo", 2020-10-05T12:10:09.022 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.022 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.022 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.023 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.512697_384.1", 2020-10-05T12:10:09.023 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.023 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-35", 2020-10-05T12:10:09.023 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.512697176Z", 2020-10-05T12:10:09.023 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.023 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.024 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.024 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.024 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.024 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_--X6GvPo7a_vb5l6gavGQUo", 2020-10-05T12:10:09.024 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.024 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.025 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.025 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.538401_385.1", 2020-10-05T12:10:09.025 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.026 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:09.026 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.538401203Z", 2020-10-05T12:10:09.026 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.026 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.026 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:09.026 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.027 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.027 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:09.027 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:09.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.027 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.027 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.028 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.544174_386.1", 2020-10-05T12:10:09.028 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.028 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:09.028 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.544174292Z", 2020-10-05T12:10:09.028 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899667.597394_387.1", 2020-10-05T12:10:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:47.597394776Z", 2020-10-05T12:10:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899667.608381_388.1", 2020-10-05T12:10:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:47.608381219Z", 2020-10-05T12:10:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.669772_389.1", 2020-10-05T12:10:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.669772427Z", 2020-10-05T12:10:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.681403_390.1", 2020-10-05T12:10:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.681403105Z", 2020-10-05T12:10:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.755317_391.1", 2020-10-05T12:10:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-36:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.36", 2020-10-05T12:10:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.755317269Z", 2020-10-05T12:10:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_3icl_ECM1V9msMyvu87yxtG", 2020-10-05T12:10:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.760371_392.1", 2020-10-05T12:10:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-36:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.36", 2020-10-05T12:10:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.760371672Z", 2020-10-05T12:10:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_3icl_ECM1V9msMyvu87yxtG", 2020-10-05T12:10:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.762899_393.1", 2020-10-05T12:10:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-36", 2020-10-05T12:10:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.762899080Z", 2020-10-05T12:10:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_8WZRY6hDRE8a9myMhYrKAX_", 2020-10-05T12:10:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.048 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.048 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.048 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.767561_394.1", 2020-10-05T12:10:09.049 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.049 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-36", 2020-10-05T12:10:09.049 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.767561731Z", 2020-10-05T12:10:09.049 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.049 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.049 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.049 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.050 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.050 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_8WZRY6hDRE8a9myMhYrKAX_", 2020-10-05T12:10:09.050 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.050 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.050 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.051 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.797969_395.1", 2020-10-05T12:10:09.051 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.051 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-37:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.37", 2020-10-05T12:10:09.051 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.797969247Z", 2020-10-05T12:10:09.052 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.052 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.052 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.052 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.052 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.052 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rp3Sewj1i--RN9QFC9kTl1R", 2020-10-05T12:10:09.053 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.053 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.053 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.054 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.802805_396.1", 2020-10-05T12:10:09.054 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.054 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-37:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.37", 2020-10-05T12:10:09.054 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.802805288Z", 2020-10-05T12:10:09.054 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.054 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.054 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.055 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.055 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.055 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rp3Sewj1i--RN9QFC9kTl1R", 2020-10-05T12:10:09.055 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.055 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.055 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.056 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.804808_397.1", 2020-10-05T12:10:09.056 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.056 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-37", 2020-10-05T12:10:09.057 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.804808204Z", 2020-10-05T12:10:09.057 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.057 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.057 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.057 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.057 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_m6h3qoVJUfeAaOYxYpjLCny", 2020-10-05T12:10:09.058 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.058 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.058 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.059 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.808515_398.1", 2020-10-05T12:10:09.059 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.059 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-37", 2020-10-05T12:10:09.059 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.808515097Z", 2020-10-05T12:10:09.059 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.059 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.060 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.060 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.060 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.060 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_m6h3qoVJUfeAaOYxYpjLCny", 2020-10-05T12:10:09.060 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.060 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.061 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.061 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.872453_399.1", 2020-10-05T12:10:09.061 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.062 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-38:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.38", 2020-10-05T12:10:09.062 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.872453804Z", 2020-10-05T12:10:09.062 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.062 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.062 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.062 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.063 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.063 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_-HoKnRhe8TocC-rxrrEt-K9", 2020-10-05T12:10:09.063 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.063 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.063 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.063 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.064 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.876761_400.1", 2020-10-05T12:10:09.064 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.064 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-38:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.38", 2020-10-05T12:10:09.064 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.876761083Z", 2020-10-05T12:10:09.064 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.065 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.065 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.065 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.065 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.065 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_-HoKnRhe8TocC-rxrrEt-K9", 2020-10-05T12:10:09.065 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.066 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.066 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.066 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.879002_401.1", 2020-10-05T12:10:09.067 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.067 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-38", 2020-10-05T12:10:09.067 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.879002719Z", 2020-10-05T12:10:09.067 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.067 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.067 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.068 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.068 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_s0iZkzLPbkOXiRUVThv-a9T", 2020-10-05T12:10:09.068 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.068 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.068 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.069 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.888419_402.1", 2020-10-05T12:10:09.069 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.069 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-38", 2020-10-05T12:10:09.069 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.888419542Z", 2020-10-05T12:10:09.070 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.070 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.070 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.070 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.070 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.070 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_s0iZkzLPbkOXiRUVThv-a9T", 2020-10-05T12:10:09.071 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.071 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.071 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.072 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.482263_403.1", 2020-10-05T12:10:09.072 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.072 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-39:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.39", 2020-10-05T12:10:09.072 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.482263867Z", 2020-10-05T12:10:09.072 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.072 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.072 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.073 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.073 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.073 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_mBr7LUv6iNJJo-p_fWMP8K5", 2020-10-05T12:10:09.073 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.073 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.073 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.074 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.486347_405.1", 2020-10-05T12:10:09.074 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.074 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-39:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.39", 2020-10-05T12:10:09.075 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.486347434Z", 2020-10-05T12:10:09.075 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.075 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.075 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.075 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.076 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_mBr7LUv6iNJJo-p_fWMP8K5", 2020-10-05T12:10:09.076 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.076 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.076 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.077 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.488367_406.1", 2020-10-05T12:10:09.077 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.077 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-39", 2020-10-05T12:10:09.077 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.488367312Z", 2020-10-05T12:10:09.077 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.077 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.078 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.078 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.078 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.078 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_xFlhJ327xLR_penGucomc8D", 2020-10-05T12:10:09.078 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.079 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.079 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.080 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.492419_407.1", 2020-10-05T12:10:09.080 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.080 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-39", 2020-10-05T12:10:09.080 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.492419420Z", 2020-10-05T12:10:09.080 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.080 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.081 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.081 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.081 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.081 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_xFlhJ327xLR_penGucomc8D", 2020-10-05T12:10:09.081 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.082 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.082 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.083 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.523672_408.1", 2020-10-05T12:10:09.083 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.083 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-40:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.40", 2020-10-05T12:10:09.083 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.523672589Z", 2020-10-05T12:10:09.083 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.083 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.083 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.084 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.084 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.084 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_M4WWBNi5IJ-RWpNAHhcS0lG", 2020-10-05T12:10:09.084 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.084 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.084 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.085 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.085 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.085 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.528666_409.1", 2020-10-05T12:10:09.085 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.085 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-40:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.40", 2020-10-05T12:10:09.086 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.528666589Z", 2020-10-05T12:10:09.086 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.086 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.086 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.086 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.086 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.087 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_M4WWBNi5IJ-RWpNAHhcS0lG", 2020-10-05T12:10:09.087 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.087 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.087 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.088 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.533845_410.1", 2020-10-05T12:10:09.088 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.088 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-40", 2020-10-05T12:10:09.088 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.533845466Z", 2020-10-05T12:10:09.088 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.088 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.089 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.089 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.089 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.089 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gWvQIgj3cIEvwYjW0hD1OuM", 2020-10-05T12:10:09.089 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.089 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.090 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.090 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.090 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.090 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.541752_411.1", 2020-10-05T12:10:09.090 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.091 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-40", 2020-10-05T12:10:09.091 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.541752331Z", 2020-10-05T12:10:09.091 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.091 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.091 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.091 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.091 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.092 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gWvQIgj3cIEvwYjW0hD1OuM", 2020-10-05T12:10:09.092 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.092 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.092 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.092 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.093 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.597447_412.1", 2020-10-05T12:10:09.093 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.093 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-41:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.41", 2020-10-05T12:10:09.093 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.597447087Z", 2020-10-05T12:10:09.093 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.094 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.094 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.094 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.094 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.094 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_eaDHMmwfm1xaPKhMWupCPOl", 2020-10-05T12:10:09.094 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.095 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.095 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.095 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.602294_413.1", 2020-10-05T12:10:09.096 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.096 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-41:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.41", 2020-10-05T12:10:09.096 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.602294636Z", 2020-10-05T12:10:09.096 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.096 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.096 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.096 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.097 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.097 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_eaDHMmwfm1xaPKhMWupCPOl", 2020-10-05T12:10:09.097 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.097 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.097 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.098 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.604098_414.1", 2020-10-05T12:10:09.098 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.098 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-41", 2020-10-05T12:10:09.098 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.604098679Z", 2020-10-05T12:10:09.098 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.099 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.099 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.099 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.099 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.099 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Qk4kFwtlsplX3FbEXjLvzNg", 2020-10-05T12:10:09.099 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.100 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.100 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.101 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.607428_415.1", 2020-10-05T12:10:09.101 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.101 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-41", 2020-10-05T12:10:09.101 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.607428984Z", 2020-10-05T12:10:09.101 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.101 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.101 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.101 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.102 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.103 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Qk4kFwtlsplX3FbEXjLvzNg", 2020-10-05T12:10:09.103 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.104 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.104 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.105 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.309220_45.1", 2020-10-05T12:10:09.105 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.105 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-1:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.1", 2020-10-05T12:10:09.105 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.309220986Z", 2020-10-05T12:10:09.105 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.105 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.105 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.106 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.106 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.106 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_yW5321q_H3rgrXH_8hp_2oS", 2020-10-05T12:10:09.106 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.106 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.107 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.107 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.323188_52.1", 2020-10-05T12:10:09.107 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.108 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-1:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.1", 2020-10-05T12:10:09.108 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.323188619Z", 2020-10-05T12:10:09.108 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.108 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.108 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.108 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.108 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.109 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_yW5321q_H3rgrXH_8hp_2oS", 2020-10-05T12:10:09.109 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.109 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.109 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.110 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.324606_53.1", 2020-10-05T12:10:09.110 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.110 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-1", 2020-10-05T12:10:09.110 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.324606525Z", 2020-10-05T12:10:09.110 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.111 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.111 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.111 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_O5mZZC9qWHtFDZP9jX8TRT7", 2020-10-05T12:10:09.111 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.112 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.112 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.112 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.330398_54.1", 2020-10-05T12:10:09.113 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.113 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-1", 2020-10-05T12:10:09.113 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.330398615Z", 2020-10-05T12:10:09.113 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.113 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.113 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.113 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.114 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.114 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_O5mZZC9qWHtFDZP9jX8TRT7", 2020-10-05T12:10:09.114 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.114 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.114 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.115 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.352875_55.1", 2020-10-05T12:10:09.115 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.115 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-2:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.2", 2020-10-05T12:10:09.115 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.352875916Z", 2020-10-05T12:10:09.116 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.116 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.116 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.116 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.116 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.116 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_jFiFlBW0gJEjys5t9-_iV1V", 2020-10-05T12:10:09.117 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.117 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.117 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.118 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.359690_56.1", 2020-10-05T12:10:09.118 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.118 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-2:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.2", 2020-10-05T12:10:09.118 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.359690270Z", 2020-10-05T12:10:09.118 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.118 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.118 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.119 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.119 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.119 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_jFiFlBW0gJEjys5t9-_iV1V", 2020-10-05T12:10:09.119 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.119 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.120 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.120 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.362078_57.1", 2020-10-05T12:10:09.120 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.121 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-2", 2020-10-05T12:10:09.121 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.362078463Z", 2020-10-05T12:10:09.121 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.121 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.121 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.121 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.122 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.122 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_WwokRaHlmdENZ_Gh_tirmfG", 2020-10-05T12:10:09.122 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.122 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.122 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.122 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.122 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.123 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.372604_58.1", 2020-10-05T12:10:09.123 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.123 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-2", 2020-10-05T12:10:09.123 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.372604328Z", 2020-10-05T12:10:09.123 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.124 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.124 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.124 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.124 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.124 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_WwokRaHlmdENZ_Gh_tirmfG", 2020-10-05T12:10:09.124 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.125 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.125 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.125 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899136.699771_60.1", 2020-10-05T12:10:09.126 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.126 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-3:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.3", 2020-10-05T12:10:09.126 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:56.699771738Z", 2020-10-05T12:10:09.126 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.126 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.126 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.126 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.127 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.127 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rmwjFru8PLxDCA-VIsNWDx7", 2020-10-05T12:10:09.127 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.127 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.127 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.128 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899136.704901_61.1", 2020-10-05T12:10:09.128 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.128 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-3:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.3", 2020-10-05T12:10:09.128 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:56.704901138Z", 2020-10-05T12:10:09.129 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.129 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.129 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.129 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.129 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.129 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rmwjFru8PLxDCA-VIsNWDx7", 2020-10-05T12:10:09.130 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.130 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.130 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.131 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899136.707633_62.1", 2020-10-05T12:10:09.131 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.131 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-3", 2020-10-05T12:10:09.131 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:56.707633249Z", 2020-10-05T12:10:09.131 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.131 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.131 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.132 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.132 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.132 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Ae2fl6vm7rY1i6OtshHDi2X", 2020-10-05T12:10:09.132 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.132 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.133 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.193 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899136.712011_63.1", 2020-10-05T12:10:09.193 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.193 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-3", 2020-10-05T12:10:09.193 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:56.712011683Z", 2020-10-05T12:10:09.193 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.194 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.194 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.194 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.194 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.194 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Ae2fl6vm7rY1i6OtshHDi2X", 2020-10-05T12:10:09.194 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.195 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.195 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.195 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899137.978801_67.1", 2020-10-05T12:10:09.196 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.196 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-4:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.4", 2020-10-05T12:10:09.196 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:57.978801960Z", 2020-10-05T12:10:09.196 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.196 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.196 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.196 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.197 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.197 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_R9cr1AM7-ROLCvUODxti2Hy", 2020-10-05T12:10:09.197 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.197 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.198 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.200 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899137.983575_68.1", 2020-10-05T12:10:09.200 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.200 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-4:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.4", 2020-10-05T12:10:09.200 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:57.983575708Z", 2020-10-05T12:10:09.201 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.201 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.201 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.201 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.202 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.202 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_R9cr1AM7-ROLCvUODxti2Hy", 2020-10-05T12:10:09.202 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.203 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.203 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.204 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899137.985378_69.1", 2020-10-05T12:10:09.205 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.205 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-4", 2020-10-05T12:10:09.205 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:57.985378089Z", 2020-10-05T12:10:09.205 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.205 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.206 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.206 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.207 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.207 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_L7bOK0Z4V74uuwLURFH192I", 2020-10-05T12:10:09.208 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.208 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.209 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.210 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899137.989603_70.1", 2020-10-05T12:10:09.210 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.210 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-4", 2020-10-05T12:10:09.210 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:57.989603894Z", 2020-10-05T12:10:09.211 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.211 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.211 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.212 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.212 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.212 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_L7bOK0Z4V74uuwLURFH192I", 2020-10-05T12:10:09.213 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.213 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.213 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.214 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.214 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.214 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.008931_71.1", 2020-10-05T12:10:09.215 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.215 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-5:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.5", 2020-10-05T12:10:09.215 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.008931512Z", 2020-10-05T12:10:09.215 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.216 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.216 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.216 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.217 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.217 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_mFQkTXg1VqZK7t8XsW9miUA", 2020-10-05T12:10:09.217 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.218 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.219 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.220 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.013300_72.1", 2020-10-05T12:10:09.221 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.221 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-5:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.5", 2020-10-05T12:10:09.221 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.013300296Z", 2020-10-05T12:10:09.222 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.223 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.223 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.223 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.224 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.224 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_mFQkTXg1VqZK7t8XsW9miUA", 2020-10-05T12:10:09.224 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.225 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.225 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.226 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.015249_73.1", 2020-10-05T12:10:09.227 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.227 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-5", 2020-10-05T12:10:09.227 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.015249875Z", 2020-10-05T12:10:09.227 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.228 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.229 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.229 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.229 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.230 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_SdAKsFkJizj_YE8B3JhFv3K", 2020-10-05T12:10:09.230 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.231 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.231 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.232 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.019329_74.1", 2020-10-05T12:10:09.232 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.232 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-5", 2020-10-05T12:10:09.232 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.019329476Z", 2020-10-05T12:10:09.232 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.233 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.233 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.233 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.233 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.233 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_SdAKsFkJizj_YE8B3JhFv3K", 2020-10-05T12:10:09.233 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.234 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.234 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.235 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.062991_75.1", 2020-10-05T12:10:09.235 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.235 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-6:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.6", 2020-10-05T12:10:09.235 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.062991051Z", 2020-10-05T12:10:09.235 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.235 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.236 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.236 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.236 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.236 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_h3WoSQnsgDcU-Zg3rO1vbjh", 2020-10-05T12:10:09.236 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.237 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.237 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.237 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.067217_76.1", 2020-10-05T12:10:09.238 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.238 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-6:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.6", 2020-10-05T12:10:09.238 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.067217484Z", 2020-10-05T12:10:09.238 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.238 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.238 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.239 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.239 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.240 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_h3WoSQnsgDcU-Zg3rO1vbjh", 2020-10-05T12:10:09.240 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.240 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.240 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.241 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.069962_77.1", 2020-10-05T12:10:09.241 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.241 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-6", 2020-10-05T12:10:09.242 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.069962715Z", 2020-10-05T12:10:09.242 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.242 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.242 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.242 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.242 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.243 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_au9QcNPZmxYIo3XlQDwiive", 2020-10-05T12:10:09.243 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.243 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.243 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.244 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.076875_78.1", 2020-10-05T12:10:09.244 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.244 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-6", 2020-10-05T12:10:09.244 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.076875124Z", 2020-10-05T12:10:09.244 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.245 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.245 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.245 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.245 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.245 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_au9QcNPZmxYIo3XlQDwiive", 2020-10-05T12:10:09.245 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.246 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.246 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.247 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.926594_79.1", 2020-10-05T12:10:09.247 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.247 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-7:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.7", 2020-10-05T12:10:09.247 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.926594218Z", 2020-10-05T12:10:09.247 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.247 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.247 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.248 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.248 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.248 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cPLQuBKjrWMkd6tqHbbfy0H", 2020-10-05T12:10:09.248 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.248 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.249 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.250 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.931290_84.1", 2020-10-05T12:10:09.250 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.250 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-7:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.7", 2020-10-05T12:10:09.250 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.931290785Z", 2020-10-05T12:10:09.251 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.251 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.251 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.251 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.251 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.252 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cPLQuBKjrWMkd6tqHbbfy0H", 2020-10-05T12:10:09.252 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.252 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.252 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.253 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.933342_85.1", 2020-10-05T12:10:09.253 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.253 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-7", 2020-10-05T12:10:09.253 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.933342285Z", 2020-10-05T12:10:09.253 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.254 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.254 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.254 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.254 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.254 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:09.255 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.255 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.256 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.257 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.939592_86.1", 2020-10-05T12:10:09.257 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.257 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-7", 2020-10-05T12:10:09.257 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.939592960Z", 2020-10-05T12:10:09.257 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.257 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.258 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.258 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.258 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.258 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:09.258 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.259 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.259 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.259 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.961360_87.1", 2020-10-05T12:10:09.260 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.260 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-8:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.8", 2020-10-05T12:10:09.260 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.961360327Z", 2020-10-05T12:10:09.260 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.260 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.260 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.260 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.261 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.261 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_VfDg-vSGbYSY-RkVKPKcS4N", 2020-10-05T12:10:09.261 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.261 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.261 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.262 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.966517_88.1", 2020-10-05T12:10:09.262 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.262 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-8:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.8", 2020-10-05T12:10:09.262 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.966517542Z", 2020-10-05T12:10:09.263 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.263 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.263 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.263 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_VfDg-vSGbYSY-RkVKPKcS4N", 2020-10-05T12:10:09.264 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.264 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.264 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.265 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.970413_89.1", 2020-10-05T12:10:09.265 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.265 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-8", 2020-10-05T12:10:09.265 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.970413680Z", 2020-10-05T12:10:09.265 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.265 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.265 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.266 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.266 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.266 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:09.266 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.266 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.267 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.267 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.978679_90.1", 2020-10-05T12:10:09.267 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.267 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-8", 2020-10-05T12:10:09.268 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.978679498Z", 2020-10-05T12:10:09.268 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.268 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.268 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.268 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.268 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.269 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:09.269 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.269 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.269 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.270 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899141.016163_91.1", 2020-10-05T12:10:09.270 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.270 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-9:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.9", 2020-10-05T12:10:09.270 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:01.016163231Z", 2020-10-05T12:10:09.270 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.271 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.271 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.271 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.271 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.271 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Du3Kn9J3DjlCQqjeBWYnZfm", 2020-10-05T12:10:09.271 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.272 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.272 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.272 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899141.026253_92.1", 2020-10-05T12:10:09.273 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.273 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-9:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.9", 2020-10-05T12:10:09.273 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:01.026253368Z", 2020-10-05T12:10:09.273 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.273 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.273 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.273 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.274 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.274 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Du3Kn9J3DjlCQqjeBWYnZfm", 2020-10-05T12:10:09.274 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.274 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.274 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.275 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899141.029629_93.1", 2020-10-05T12:10:09.275 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.275 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-9", 2020-10-05T12:10:09.275 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:01.029629977Z", 2020-10-05T12:10:09.276 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.276 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.276 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.276 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.276 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.276 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:09.277 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.277 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.277 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:09.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.278 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899141.037160_94.1", 2020-10-05T12:10:09.278 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.278 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-9", 2020-10-05T12:10:09.278 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:01.037160652Z", 2020-10-05T12:10:09.278 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.278 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.278 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:09.279 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:09.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.279 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.279 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:09.279 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.279 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.280 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.280 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899142.364959_95.1", 2020-10-05T12:10:09.280 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.281 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-7", 2020-10-05T12:10:09.281 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.364959162Z", 2020-10-05T12:10:09.281 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.281 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.281 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:09.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.281 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.282 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:09.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:09.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.282 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.282 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "remove" 2020-10-05T12:10:09.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.283 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899142.371195_98.1", 2020-10-05T12:10:09.283 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.283 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-7", 2020-10-05T12:10:09.283 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.371195860Z", 2020-10-05T12:10:09.283 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.284 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.284 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:09.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.284 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.284 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:09.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:09.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.285 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.285 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.286 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899142.428255_99.1", 2020-10-05T12:10:09.287 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.287 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-8", 2020-10-05T12:10:09.287 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.428255930Z", 2020-10-05T12:10:09.287 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.287 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.287 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:09.287 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.288 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.288 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:09.288 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:09.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.288 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.288 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "remove" 2020-10-05T12:10:09.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.289 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899142.434846_100.1", 2020-10-05T12:10:09.289 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.289 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-8", 2020-10-05T12:10:09.289 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.434846076Z", 2020-10-05T12:10:09.290 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.290 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:09.290 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.290 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:09.291 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:09.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.291 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.291 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.291 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.291 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899142.528196_101.1", 2020-10-05T12:10:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-9", 2020-10-05T12:10:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.528196199Z", 2020-10-05T12:10:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:09.293 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.293 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.293 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:09.293 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:09.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.293 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "remove" 2020-10-05T12:10:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899142.535244_102.1", 2020-10-05T12:10:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:09.294 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-9", 2020-10-05T12:10:09.295 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244574Z", 2020-10-05T12:10:09.295 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:09.295 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:09.295 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:09.295 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:09.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.295 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:09.296 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:09.296 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:09.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:09.296 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:09.296 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:09.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:09.297 INFO:teuthology.orchestra.run.smithi081.stdout:] 2020-10-05T12:10:09.298 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:09.299 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:09.299 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period eb044115-4632-4a42-8790-5052d87ef1c6 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:09.334 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:09.334 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:09.574 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:10:09.574 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.575 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899010.522064_46.1", 2020-10-05T12:10:09.575 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "user", 2020-10-05T12:10:09.575 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "rgw-multisite-test-user", 2020-10-05T12:10:09.575 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:56:50.522064827Z", 2020-10-05T12:10:09.575 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.575 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.575 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.576 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.576 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.576 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.576 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_XfLljzuaU2vSQ_l6_rZc8Jd", 2020-10-05T12:10:09.576 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.576 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.576 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.577 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.577 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.577 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.577 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.577 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.577 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899010.531704_48.1", 2020-10-05T12:10:09.577 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "user", 2020-10-05T12:10:09.578 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "rgw-multisite-test-user", 2020-10-05T12:10:09.578 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:56:50.531704315Z", 2020-10-05T12:10:09.578 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.578 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.578 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.578 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.578 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.579 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.579 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_XfLljzuaU2vSQ_l6_rZc8Jd", 2020-10-05T12:10:09.579 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.579 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.579 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.579 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.579 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.580 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.580 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.580 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.580 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.814004_49.1", 2020-10-05T12:10:09.580 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.580 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-10:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.10", 2020-10-05T12:10:09.580 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.814004723Z", 2020-10-05T12:10:09.580 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.581 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.581 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.581 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.581 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.581 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.581 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_OUeyPbMbUBT7BQCU4es-77f", 2020-10-05T12:10:09.581 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.582 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.582 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.582 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.582 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.582 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.582 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.582 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.583 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.820735_57.1", 2020-10-05T12:10:09.583 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.583 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-10:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.10", 2020-10-05T12:10:09.583 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.820735262Z", 2020-10-05T12:10:09.583 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.583 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.583 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.584 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.584 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.584 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.584 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_OUeyPbMbUBT7BQCU4es-77f", 2020-10-05T12:10:09.584 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.584 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.584 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.584 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.585 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.585 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.585 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.585 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.585 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.824910_58.1", 2020-10-05T12:10:09.585 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.585 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-10", 2020-10-05T12:10:09.586 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.824910635Z", 2020-10-05T12:10:09.586 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.586 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.586 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.586 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.586 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.586 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.587 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_0Xb0nTNWivrWvWx3oeYmdD5", 2020-10-05T12:10:09.587 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.587 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.587 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.587 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.587 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.587 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.587 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.588 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.588 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.833730_59.1", 2020-10-05T12:10:09.588 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.588 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-10", 2020-10-05T12:10:09.588 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.833730650Z", 2020-10-05T12:10:09.588 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.588 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.589 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.589 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.589 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.589 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.589 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_0Xb0nTNWivrWvWx3oeYmdD5", 2020-10-05T12:10:09.589 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.589 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.589 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.590 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.590 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.590 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.590 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.590 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.590 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.857632_61.1", 2020-10-05T12:10:09.590 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.591 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-11:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.11", 2020-10-05T12:10:09.591 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.857632138Z", 2020-10-05T12:10:09.591 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.591 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.591 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.591 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.591 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.592 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.592 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_v4mkZAXP0-Rav1j3dZSpNti", 2020-10-05T12:10:09.592 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.592 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.592 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.592 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.592 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.592 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.593 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.593 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.593 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.862394_62.1", 2020-10-05T12:10:09.593 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.593 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-11:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.11", 2020-10-05T12:10:09.593 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.862394648Z", 2020-10-05T12:10:09.593 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.594 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.594 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.594 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.594 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.594 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.594 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_v4mkZAXP0-Rav1j3dZSpNti", 2020-10-05T12:10:09.594 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.595 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.595 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.595 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.595 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.595 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.595 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.595 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.595 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.864807_63.1", 2020-10-05T12:10:09.596 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.596 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-11", 2020-10-05T12:10:09.596 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.864807231Z", 2020-10-05T12:10:09.596 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.596 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.596 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.596 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.597 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.597 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.597 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_L1Lb50oCzKfeW6cLgFCXcoO", 2020-10-05T12:10:09.597 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.597 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.597 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.597 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.597 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.598 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.598 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.598 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.598 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.872602_64.1", 2020-10-05T12:10:09.598 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.598 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-11", 2020-10-05T12:10:09.599 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.872602240Z", 2020-10-05T12:10:09.599 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.600 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.600 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.600 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.600 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.600 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.601 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_L1Lb50oCzKfeW6cLgFCXcoO", 2020-10-05T12:10:09.601 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.601 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.601 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.601 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.601 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.601 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.602 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.602 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.602 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.914339_65.1", 2020-10-05T12:10:09.602 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.602 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-12:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.12", 2020-10-05T12:10:09.602 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.914339616Z", 2020-10-05T12:10:09.602 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.603 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.603 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.603 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.603 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.603 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.603 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_KBFql2QH92IFaRoA6pUczcF", 2020-10-05T12:10:09.603 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.603 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.604 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.604 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.604 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.604 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.604 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.604 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.604 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.918665_66.1", 2020-10-05T12:10:09.605 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.605 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-12:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.12", 2020-10-05T12:10:09.605 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.918665490Z", 2020-10-05T12:10:09.605 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.605 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.605 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.605 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.606 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.606 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.606 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_KBFql2QH92IFaRoA6pUczcF", 2020-10-05T12:10:09.606 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.606 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.606 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.606 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.607 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.607 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.607 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.607 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.607 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.920603_67.1", 2020-10-05T12:10:09.607 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.607 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-12", 2020-10-05T12:10:09.607 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.920603439Z", 2020-10-05T12:10:09.608 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.608 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.608 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.608 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.608 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.608 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.608 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_TSIbo46j-8sw-hblvAeS41m", 2020-10-05T12:10:09.609 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.609 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.609 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.609 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.609 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.609 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.609 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.609 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.610 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899143.924911_68.1", 2020-10-05T12:10:09.610 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.610 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-12", 2020-10-05T12:10:09.610 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:03.924911466Z", 2020-10-05T12:10:09.610 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.610 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.610 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.611 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.611 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.611 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.611 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_TSIbo46j-8sw-hblvAeS41m", 2020-10-05T12:10:09.611 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.611 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.611 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.612 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.612 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.612 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.612 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.612 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.612 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.705730_167.1", 2020-10-05T12:10:09.612 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.612 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-13:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.13", 2020-10-05T12:10:09.613 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.705730871Z", 2020-10-05T12:10:09.613 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.613 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.613 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.613 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.613 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.613 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.614 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_fKSRurQRBwqim7c5GEU0PUo", 2020-10-05T12:10:09.614 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.614 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.614 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.614 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.614 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.614 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.615 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.615 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.615 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.709947_170.1", 2020-10-05T12:10:09.615 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.615 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-13:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.13", 2020-10-05T12:10:09.615 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.709947223Z", 2020-10-05T12:10:09.615 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.616 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.616 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.616 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.616 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.616 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.616 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_fKSRurQRBwqim7c5GEU0PUo", 2020-10-05T12:10:09.616 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.617 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.617 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.617 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.617 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.617 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.618 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.618 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.618 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.711830_171.1", 2020-10-05T12:10:09.618 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.618 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-13", 2020-10-05T12:10:09.618 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.711830069Z", 2020-10-05T12:10:09.618 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.619 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.619 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.619 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.619 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.619 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.619 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_6qCjZsmNHmFw8bpyRgfhvgp", 2020-10-05T12:10:09.619 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.620 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.620 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.620 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.620 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.620 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.620 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.620 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.620 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.715644_172.1", 2020-10-05T12:10:09.621 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.621 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-13", 2020-10-05T12:10:09.621 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.715644136Z", 2020-10-05T12:10:09.621 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.621 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.621 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.621 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.622 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.622 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.622 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_6qCjZsmNHmFw8bpyRgfhvgp", 2020-10-05T12:10:09.622 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.622 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.622 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.622 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.623 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.623 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.623 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.623 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.623 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.735814_173.1", 2020-10-05T12:10:09.623 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.623 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-14:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.14", 2020-10-05T12:10:09.623 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.735814205Z", 2020-10-05T12:10:09.624 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.624 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.624 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.624 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.624 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.624 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.624 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_4DMFEEdE_URAKSdIzf9-FJr", 2020-10-05T12:10:09.625 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.625 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.625 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.625 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.625 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.625 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.625 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.625 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.626 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.740366_174.1", 2020-10-05T12:10:09.626 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.626 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-14:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.14", 2020-10-05T12:10:09.626 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.740366438Z", 2020-10-05T12:10:09.626 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.626 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.626 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.627 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.627 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.627 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.627 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_4DMFEEdE_URAKSdIzf9-FJr", 2020-10-05T12:10:09.627 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.627 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.627 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.628 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.628 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.628 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.628 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.628 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.628 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.743243_175.1", 2020-10-05T12:10:09.628 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.628 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-14", 2020-10-05T12:10:09.629 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.743243682Z", 2020-10-05T12:10:09.629 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.629 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.629 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.629 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.629 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.629 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.630 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UIQfkMuDK3qo2qDganeuBr3", 2020-10-05T12:10:09.630 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.630 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.630 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.630 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.630 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.630 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.631 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.631 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.631 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.748706_176.1", 2020-10-05T12:10:09.631 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.631 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-14", 2020-10-05T12:10:09.631 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.748706141Z", 2020-10-05T12:10:09.631 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.631 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.632 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.632 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.632 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.632 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.632 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UIQfkMuDK3qo2qDganeuBr3", 2020-10-05T12:10:09.632 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.632 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.633 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.633 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.633 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.633 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.633 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.633 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.633 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.800203_177.1", 2020-10-05T12:10:09.633 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.634 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-15:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.15", 2020-10-05T12:10:09.634 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.800203983Z", 2020-10-05T12:10:09.634 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.634 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.634 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.634 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.634 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.635 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.635 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_3-e1Ii4K_TT4M1zQxUiOW6q", 2020-10-05T12:10:09.635 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.635 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.635 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.635 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.635 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.636 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.636 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.636 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.636 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.807858_178.1", 2020-10-05T12:10:09.636 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.636 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-15:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.15", 2020-10-05T12:10:09.636 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.807858930Z", 2020-10-05T12:10:09.636 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.637 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.637 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.637 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.637 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.637 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.637 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_3-e1Ii4K_TT4M1zQxUiOW6q", 2020-10-05T12:10:09.637 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.638 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.638 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.638 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.638 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.638 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.638 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.638 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.639 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.810402_179.1", 2020-10-05T12:10:09.639 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.639 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-15", 2020-10-05T12:10:09.639 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.810402748Z", 2020-10-05T12:10:09.639 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.639 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.639 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.639 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.640 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.640 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.640 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pIn_cx-kgGjdDSA4gCi-AHV", 2020-10-05T12:10:09.640 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.640 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.640 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.640 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.641 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.641 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.641 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.641 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.641 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899154.815329_180.1", 2020-10-05T12:10:09.641 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.641 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-15", 2020-10-05T12:10:09.641 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:14.815329634Z", 2020-10-05T12:10:09.642 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.642 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.642 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.642 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.642 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.642 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.642 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pIn_cx-kgGjdDSA4gCi-AHV", 2020-10-05T12:10:09.643 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.643 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.643 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.643 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.643 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.643 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.643 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.644 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.644 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.087142_206.1", 2020-10-05T12:10:09.644 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.644 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:09.644 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.087142258Z", 2020-10-05T12:10:09.644 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.644 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.644 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.645 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.645 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.645 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.645 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:09.645 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.645 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.645 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.646 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.646 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.646 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.646 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.646 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.646 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.092441_208.1", 2020-10-05T12:10:09.646 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.646 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:09.647 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.092441445Z", 2020-10-05T12:10:09.647 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.647 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.647 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.647 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.647 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.647 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.648 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:09.648 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.648 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.648 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.648 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.648 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.648 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.649 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.649 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.649 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.094590_209.1", 2020-10-05T12:10:09.649 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.649 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-16", 2020-10-05T12:10:09.649 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.094590609Z", 2020-10-05T12:10:09.649 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.649 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.650 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.650 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.650 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.650 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.650 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_19VzZjSbKDNxSKagtOnJpeP", 2020-10-05T12:10:09.650 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.650 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.651 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.651 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.651 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.651 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.651 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.651 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.651 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.098781_210.1", 2020-10-05T12:10:09.651 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.652 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-16", 2020-10-05T12:10:09.652 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.098781140Z", 2020-10-05T12:10:09.652 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.652 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.652 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.652 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.652 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.653 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.653 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_19VzZjSbKDNxSKagtOnJpeP", 2020-10-05T12:10:09.653 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.653 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.653 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.653 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.653 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.653 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.654 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.654 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.654 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.123698_211.1", 2020-10-05T12:10:09.654 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.654 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:09.654 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.123698075Z", 2020-10-05T12:10:09.655 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.655 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.655 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.655 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.655 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.655 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.656 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:09.656 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.656 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.656 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.656 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.656 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.657 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.657 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.657 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.657 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.128567_212.1", 2020-10-05T12:10:09.657 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.657 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:09.658 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.128567062Z", 2020-10-05T12:10:09.658 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.658 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.658 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.658 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.658 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.658 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.659 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:09.659 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.659 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.659 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.659 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.659 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.659 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.660 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.660 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.660 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.130568_213.1", 2020-10-05T12:10:09.660 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.660 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-17", 2020-10-05T12:10:09.660 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.130568070Z", 2020-10-05T12:10:09.660 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.661 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.661 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.661 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.661 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.661 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.661 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q4C4WlcctcpJbNFl9-F-oBc", 2020-10-05T12:10:09.661 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.661 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.662 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.662 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.662 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.662 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.662 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.662 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.662 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.134679_214.1", 2020-10-05T12:10:09.663 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.663 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-17", 2020-10-05T12:10:09.663 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.134679951Z", 2020-10-05T12:10:09.663 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.663 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.663 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.663 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.664 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.664 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.664 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q4C4WlcctcpJbNFl9-F-oBc", 2020-10-05T12:10:09.664 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.664 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.664 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.664 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.664 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.665 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.665 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.665 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.665 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.176345_215.1", 2020-10-05T12:10:09.665 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.665 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:09.665 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.176345246Z", 2020-10-05T12:10:09.666 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.666 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.666 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.666 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.666 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.666 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.666 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:09.667 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.667 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.667 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.667 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.667 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.667 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.667 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.667 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.668 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.181063_216.1", 2020-10-05T12:10:09.668 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.668 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:09.668 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.181063933Z", 2020-10-05T12:10:09.668 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.668 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.668 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.669 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.669 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.669 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.669 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:09.669 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.669 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.669 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.669 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.670 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.670 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.670 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.670 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.670 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.183114_217.1", 2020-10-05T12:10:09.670 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.670 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-18", 2020-10-05T12:10:09.671 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.183114762Z", 2020-10-05T12:10:09.671 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.671 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.671 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.671 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.671 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.671 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.672 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rsmMMhH9J_A9xJxzE-ZmVue", 2020-10-05T12:10:09.672 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.672 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.672 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.672 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.672 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.672 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.673 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.673 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.673 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.187062_218.1", 2020-10-05T12:10:09.673 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.673 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-18", 2020-10-05T12:10:09.673 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.187062554Z", 2020-10-05T12:10:09.674 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.674 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.674 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.674 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.674 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.674 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.674 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rsmMMhH9J_A9xJxzE-ZmVue", 2020-10-05T12:10:09.675 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.675 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.675 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.675 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.675 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.675 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.675 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.676 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.676 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.209336_219.1", 2020-10-05T12:10:09.676 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.676 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:09.676 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.209336756Z", 2020-10-05T12:10:09.676 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.676 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.677 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:09.677 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.677 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.677 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.677 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:09.677 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.677 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.677 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.678 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.678 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.678 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.678 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.678 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.678 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.221609_220.1", 2020-10-05T12:10:09.678 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.679 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:09.679 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.221609923Z", 2020-10-05T12:10:09.679 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.679 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.679 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:09.679 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.679 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.680 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.680 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:09.680 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.680 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.680 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.680 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.680 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.681 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.681 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.681 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.681 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.229421_221.1", 2020-10-05T12:10:09.681 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.681 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:09.681 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.229421160Z", 2020-10-05T12:10:09.681 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.682 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.682 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:09.682 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.682 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.682 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.682 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:09.682 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.683 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.683 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.683 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.683 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.683 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.683 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.683 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.684 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.237256_222.1", 2020-10-05T12:10:09.684 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.684 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:09.684 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.237256353Z", 2020-10-05T12:10:09.684 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.684 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.684 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:09.684 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.685 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.685 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.685 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:09.685 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.685 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.685 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.685 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.686 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.686 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.686 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.686 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.686 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.249534_223.1", 2020-10-05T12:10:09.686 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.686 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:09.687 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.249534958Z", 2020-10-05T12:10:09.687 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.687 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.687 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:09.687 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.687 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.687 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.687 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:09.688 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.688 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.688 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.688 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.688 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.688 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.688 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.688 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.689 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899209.261322_224.1", 2020-10-05T12:10:09.689 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.689 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:09.689 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:00:09.261322106Z", 2020-10-05T12:10:09.689 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.689 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.689 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:09.690 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.690 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.690 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.690 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:09.690 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.690 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.690 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.691 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.691 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.691 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.691 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.691 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.691 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899381.978408_225.1", 2020-10-05T12:10:09.691 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.691 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:09.692 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:01.978408731Z", 2020-10-05T12:10:09.692 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.692 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.692 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.692 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.692 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.692 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.693 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:09.693 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.693 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.693 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.693 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.693 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.693 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.693 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.694 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.694 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899381.982368_241.1", 2020-10-05T12:10:09.694 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.694 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:09.694 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:01.982368788Z", 2020-10-05T12:10:09.694 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.694 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.695 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.695 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.695 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.695 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.695 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:09.695 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.695 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.695 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.696 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.696 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.696 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.696 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.696 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.696 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899381.984906_242.1", 2020-10-05T12:10:09.696 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.697 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-19", 2020-10-05T12:10:09.697 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:01.984906741Z", 2020-10-05T12:10:09.697 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.697 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.697 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.697 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.697 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.697 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.698 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_xxeD7TssMyWfSY39I2Qdo-t", 2020-10-05T12:10:09.698 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.698 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.698 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.698 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.698 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.698 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.699 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.699 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.699 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899381.988824_243.1", 2020-10-05T12:10:09.699 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.699 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-19", 2020-10-05T12:10:09.699 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:01.988824875Z", 2020-10-05T12:10:09.699 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.700 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.700 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.700 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.700 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.700 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.700 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_xxeD7TssMyWfSY39I2Qdo-t", 2020-10-05T12:10:09.700 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.700 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.701 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.701 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.701 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.701 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.701 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.701 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.701 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899381.995677_244.1", 2020-10-05T12:10:09.702 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.702 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:09.702 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:01.995677672Z", 2020-10-05T12:10:09.702 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.702 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.702 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:09.702 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.703 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.703 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.703 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:09.703 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.703 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.703 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.703 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.703 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.704 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.704 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.704 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.704 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899382.001389_245.1", 2020-10-05T12:10:09.704 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.704 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:09.704 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:02.001389904Z", 2020-10-05T12:10:09.705 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.705 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.705 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:09.705 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.705 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.705 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.705 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:09.705 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.706 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.706 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.706 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.706 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.706 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.706 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.706 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.707 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899541.302756_246.1", 2020-10-05T12:10:09.707 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.707 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:09.707 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:05:41.302756422Z", 2020-10-05T12:10:09.707 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.707 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.707 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.708 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.708 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.708 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.708 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:09.708 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.708 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.708 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.708 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.709 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.709 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.709 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.709 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.709 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899541.307820_257.1", 2020-10-05T12:10:09.709 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.709 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:09.710 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:05:41.307820582Z", 2020-10-05T12:10:09.710 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.710 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.710 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.710 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.710 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.710 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.710 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:09.711 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.711 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.711 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.711 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.711 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.711 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.711 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.712 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.712 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899541.310387_258.1", 2020-10-05T12:10:09.712 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.712 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20", 2020-10-05T12:10:09.712 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:05:41.310387536Z", 2020-10-05T12:10:09.712 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.712 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.713 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.713 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.713 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.713 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.713 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_aImoYIeVSR4CuPJ5tgqZ62Z", 2020-10-05T12:10:09.713 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.713 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.713 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.714 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.714 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.714 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.714 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.714 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.714 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899541.316365_259.1", 2020-10-05T12:10:09.714 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.715 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20", 2020-10-05T12:10:09.715 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:05:41.316365619Z", 2020-10-05T12:10:09.715 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.715 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.715 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.715 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.715 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.715 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.716 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_aImoYIeVSR4CuPJ5tgqZ62Z", 2020-10-05T12:10:09.716 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.716 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.716 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.716 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.716 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.716 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.717 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.717 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.717 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899545.730156_260.1", 2020-10-05T12:10:09.717 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.717 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:09.717 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:05:45.730156910Z", 2020-10-05T12:10:09.717 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.718 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.718 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:09.718 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.718 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.718 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.718 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:09.718 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.718 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.719 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.719 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.719 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.719 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.719 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.719 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.719 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899545.740215_264.1", 2020-10-05T12:10:09.720 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.720 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:09.720 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:05:45.740215247Z", 2020-10-05T12:10:09.720 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.720 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.720 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:09.720 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.721 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.721 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.721 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:09.721 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.721 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.721 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.721 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.722 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.722 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.722 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.722 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.722 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899605.527412_276.1", 2020-10-05T12:10:09.722 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.722 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:09.722 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:06:45.527412662Z", 2020-10-05T12:10:09.723 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.723 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.723 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:09.723 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.723 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.723 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.723 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:09.724 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:09.724 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.724 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.724 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.724 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.724 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.724 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.725 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.725 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899605.537934_277.1", 2020-10-05T12:10:09.725 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.725 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:09.725 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:06:45.537934497Z", 2020-10-05T12:10:09.725 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.725 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.725 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:09.726 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.726 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.726 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.726 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:09.726 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:09.726 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.726 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.727 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.727 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.727 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.727 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.727 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.727 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.340791_278.1", 2020-10-05T12:10:09.727 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.728 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:09.728 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.340791891Z", 2020-10-05T12:10:09.728 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.728 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.728 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.728 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.728 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.728 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.729 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:09.729 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.729 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.729 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.729 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.729 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.729 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.730 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.730 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.730 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.345737_282.1", 2020-10-05T12:10:09.730 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.730 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:09.730 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.345737029Z", 2020-10-05T12:10:09.730 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.730 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.731 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.731 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.731 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.731 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.731 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:09.731 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.731 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.732 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.732 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.732 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.732 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.732 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.732 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.732 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.348030_283.1", 2020-10-05T12:10:09.733 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.733 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-21", 2020-10-05T12:10:09.733 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.348030701Z", 2020-10-05T12:10:09.733 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.733 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.733 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.733 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.733 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.734 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.734 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_WJ0jiCyt20VpMPgS98Z4nqG", 2020-10-05T12:10:09.734 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.734 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.734 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.734 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.734 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.735 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.735 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.735 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.735 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.352832_284.1", 2020-10-05T12:10:09.735 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.735 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-21", 2020-10-05T12:10:09.735 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.352832690Z", 2020-10-05T12:10:09.735 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.736 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.736 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.736 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.736 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.736 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.736 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_WJ0jiCyt20VpMPgS98Z4nqG", 2020-10-05T12:10:09.736 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.737 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.737 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.737 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.737 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.737 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.737 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.737 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.737 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.383105_285.1", 2020-10-05T12:10:09.738 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.738 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:09.738 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.383105561Z", 2020-10-05T12:10:09.738 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.738 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.738 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.738 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.739 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.739 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.739 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:09.739 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.739 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.739 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.739 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.740 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.740 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.740 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.740 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.740 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.388239_286.1", 2020-10-05T12:10:09.740 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.740 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:09.740 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.388239047Z", 2020-10-05T12:10:09.741 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.741 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.741 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.741 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.741 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.741 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.741 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:09.742 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.742 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.742 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.742 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.742 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.742 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.742 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.743 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.743 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.390789_287.1", 2020-10-05T12:10:09.743 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.743 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-22", 2020-10-05T12:10:09.743 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.390789948Z", 2020-10-05T12:10:09.743 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.743 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.743 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.744 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.744 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.744 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.744 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_0_1hH9wu8fdrjzn6LfnAjui", 2020-10-05T12:10:09.744 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.744 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.744 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.745 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.745 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.745 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.745 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.745 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.745 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.399241_288.1", 2020-10-05T12:10:09.745 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.746 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-22", 2020-10-05T12:10:09.746 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.399241994Z", 2020-10-05T12:10:09.746 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.746 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.746 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.746 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.746 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.747 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.747 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_0_1hH9wu8fdrjzn6LfnAjui", 2020-10-05T12:10:09.747 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.747 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.747 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.747 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.747 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.748 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.748 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.748 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.748 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.452745_289.1", 2020-10-05T12:10:09.748 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.748 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:09.748 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.452745488Z", 2020-10-05T12:10:09.748 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.749 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.749 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.749 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.749 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.749 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.749 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:09.749 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.750 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.750 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.750 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.750 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.750 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.750 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.750 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.751 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.456617_290.1", 2020-10-05T12:10:09.751 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.751 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:09.751 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.456617145Z", 2020-10-05T12:10:09.751 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.751 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.751 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.751 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.752 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.752 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.752 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:09.752 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.752 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.752 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.752 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.753 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.753 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.753 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.753 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.753 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.458367_291.1", 2020-10-05T12:10:09.753 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.753 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-23", 2020-10-05T12:10:09.753 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.458367135Z", 2020-10-05T12:10:09.754 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.754 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.754 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.754 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.754 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.754 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.754 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U97spIGYsVsG6Wu0_S4U1qa", 2020-10-05T12:10:09.755 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.755 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.755 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.755 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.755 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.755 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.755 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.756 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.756 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.461785_292.1", 2020-10-05T12:10:09.756 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.756 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-23", 2020-10-05T12:10:09.756 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.461785134Z", 2020-10-05T12:10:09.756 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.756 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.757 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.757 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.757 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.757 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.757 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U97spIGYsVsG6Wu0_S4U1qa", 2020-10-05T12:10:09.757 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.757 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.758 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.758 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.758 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.758 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.758 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.758 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.758 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.486140_293.1", 2020-10-05T12:10:09.759 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.759 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:09.759 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.486140603Z", 2020-10-05T12:10:09.759 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.759 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.759 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:09.759 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.759 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.760 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.760 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:09.760 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.760 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.760 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.760 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.760 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.760 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.761 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.761 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.761 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.490948_294.1", 2020-10-05T12:10:09.761 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.761 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:09.761 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.490948615Z", 2020-10-05T12:10:09.761 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.762 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.762 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:09.762 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.762 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.762 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.762 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:09.762 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.763 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.763 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.763 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.763 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.763 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.763 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.763 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.763 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.494647_295.1", 2020-10-05T12:10:09.764 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.764 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:09.764 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.494647353Z", 2020-10-05T12:10:09.764 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.764 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.764 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:09.764 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.765 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.765 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.765 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:09.765 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.765 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.765 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.765 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.765 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.766 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.766 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.766 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.766 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.499864_296.1", 2020-10-05T12:10:09.766 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.766 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:09.766 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.499864471Z", 2020-10-05T12:10:09.767 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.767 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.767 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:09.767 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.767 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.767 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.767 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:09.768 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.768 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.768 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.768 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.768 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.768 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.768 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.768 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.769 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.507738_297.1", 2020-10-05T12:10:09.769 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.769 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:09.769 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.507738076Z", 2020-10-05T12:10:09.769 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.769 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.769 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:09.770 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.770 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.770 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.770 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:09.770 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.770 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.770 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.770 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.771 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.771 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.771 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.771 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.771 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899645.514287_298.1", 2020-10-05T12:10:09.771 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.771 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:09.772 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:25.514287293Z", 2020-10-05T12:10:09.772 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.772 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.772 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:09.772 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.772 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.772 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.773 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:09.773 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.773 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.773 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.773 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.773 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.773 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.773 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.774 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.774 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.084952_299.1", 2020-10-05T12:10:09.774 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.774 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:09.774 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.084952678Z", 2020-10-05T12:10:09.774 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.774 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.775 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.775 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.775 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.775 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.775 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:09.775 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.775 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.776 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.776 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.776 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.776 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.776 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.776 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.776 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.089798_307.1", 2020-10-05T12:10:09.776 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.777 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:09.777 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.089798521Z", 2020-10-05T12:10:09.777 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.777 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.777 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.777 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.777 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.778 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.778 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:09.778 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.778 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.778 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.778 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.778 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.779 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.779 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.779 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.779 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.091945_308.1", 2020-10-05T12:10:09.779 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.779 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24", 2020-10-05T12:10:09.779 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.091945247Z", 2020-10-05T12:10:09.779 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.780 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.780 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.780 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.780 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.780 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.780 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_d3QvlMaZvFDsG6fmQcvxore", 2020-10-05T12:10:09.780 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.781 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.781 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.781 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.781 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.781 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.781 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.781 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.781 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.096693_309.1", 2020-10-05T12:10:09.782 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.782 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24", 2020-10-05T12:10:09.782 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.096693948Z", 2020-10-05T12:10:09.782 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.782 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.782 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.782 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.783 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.783 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.783 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_d3QvlMaZvFDsG6fmQcvxore", 2020-10-05T12:10:09.783 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.783 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.783 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.783 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.784 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.784 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.784 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.784 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.784 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.119884_310.1", 2020-10-05T12:10:09.784 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.784 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:09.785 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.119884574Z", 2020-10-05T12:10:09.785 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.785 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.785 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.785 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.785 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.785 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.785 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:09.786 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.786 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.786 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.786 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.786 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.786 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.786 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.787 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.787 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.125073_311.1", 2020-10-05T12:10:09.787 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.787 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:09.787 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.125073988Z", 2020-10-05T12:10:09.787 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.787 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.787 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.788 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.788 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.788 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.788 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:09.788 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.788 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.788 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.789 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.789 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.789 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.789 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.789 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.789 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.127106_312.1", 2020-10-05T12:10:09.789 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.789 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25", 2020-10-05T12:10:09.790 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.127106528Z", 2020-10-05T12:10:09.790 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.790 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.790 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.790 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.790 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.790 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.791 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_0GztoLidLt71aeEmYBk2KIv", 2020-10-05T12:10:09.791 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.791 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.791 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.791 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.791 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.791 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.791 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.792 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.792 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.131736_313.1", 2020-10-05T12:10:09.792 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.792 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25", 2020-10-05T12:10:09.792 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.131736717Z", 2020-10-05T12:10:09.792 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.792 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.793 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.793 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.793 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.793 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.793 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_0GztoLidLt71aeEmYBk2KIv", 2020-10-05T12:10:09.793 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.793 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.793 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.794 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.794 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.794 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.794 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.794 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.794 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.176263_314.1", 2020-10-05T12:10:09.794 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.795 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:09.795 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.176263727Z", 2020-10-05T12:10:09.795 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.795 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.795 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.795 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.795 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.795 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.796 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:09.796 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.796 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.796 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.796 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.796 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.796 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.797 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.797 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.797 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.180812_315.1", 2020-10-05T12:10:09.797 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.797 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:09.797 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.180812847Z", 2020-10-05T12:10:09.797 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.797 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.798 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.798 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.798 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.798 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.798 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:09.798 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.798 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.799 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.799 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.799 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.799 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.799 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.799 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.799 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.182989_316.1", 2020-10-05T12:10:09.799 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.800 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26", 2020-10-05T12:10:09.800 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.182989968Z", 2020-10-05T12:10:09.800 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.800 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.800 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.800 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.800 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.801 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.801 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t91eQVT6DZi4rGBjwoymGxg", 2020-10-05T12:10:09.801 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.801 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.801 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.801 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.801 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.801 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.802 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.802 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.802 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.186900_317.1", 2020-10-05T12:10:09.802 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.802 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26", 2020-10-05T12:10:09.802 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.186900962Z", 2020-10-05T12:10:09.802 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.803 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.803 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.803 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.803 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.803 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.803 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t91eQVT6DZi4rGBjwoymGxg", 2020-10-05T12:10:09.803 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.803 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.804 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.804 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.804 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.804 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.804 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.804 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.805 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.207415_318.1", 2020-10-05T12:10:09.805 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.805 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:09.805 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.207415448Z", 2020-10-05T12:10:09.805 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.805 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.805 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:09.805 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.806 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.806 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.806 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:09.806 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.806 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.806 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.806 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.807 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.807 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.807 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.807 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.807 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.212772_319.1", 2020-10-05T12:10:09.807 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.807 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:09.808 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.212772752Z", 2020-10-05T12:10:09.808 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.808 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.808 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:09.808 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.808 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.808 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.808 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:09.809 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.809 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.809 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.809 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.809 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.809 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.809 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.810 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.810 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.216174_320.1", 2020-10-05T12:10:09.810 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.810 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:09.810 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.216174966Z", 2020-10-05T12:10:09.810 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.810 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.810 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:09.811 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.811 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.811 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.811 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:09.811 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:09.811 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.811 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.812 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.812 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.812 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.812 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.812 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.812 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.222896_321.1", 2020-10-05T12:10:09.812 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.812 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:09.813 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.222896035Z", 2020-10-05T12:10:09.813 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.813 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.813 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:09.813 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.813 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.813 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.814 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:09.814 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:09.814 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.814 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.814 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.814 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.814 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.814 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.815 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.815 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.228952_322.1", 2020-10-05T12:10:09.815 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.815 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:09.815 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.228952822Z", 2020-10-05T12:10:09.815 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.815 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.816 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:09.816 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.816 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.816 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.816 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:09.816 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.816 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.816 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.817 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.817 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.818 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.819 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.819 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.819 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.241169_323.1", 2020-10-05T12:10:09.819 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.819 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:09.819 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.241169846Z", 2020-10-05T12:10:09.820 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.820 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.820 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:09.820 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.820 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.820 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.820 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:09.821 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.821 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.821 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.821 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.821 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.821 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.821 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.821 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.822 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.267420_324.1", 2020-10-05T12:10:09.822 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.822 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:09.822 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.267420223Z", 2020-10-05T12:10:09.822 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.822 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.822 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:09.823 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.823 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.823 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.823 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:09.823 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:09.823 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.823 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.824 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.824 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.824 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.824 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.824 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.824 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.272326_325.1", 2020-10-05T12:10:09.824 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.825 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:09.825 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.272326174Z", 2020-10-05T12:10:09.825 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.825 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.825 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:09.825 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.825 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.825 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.826 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:09.826 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:09.826 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.826 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.826 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.826 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.826 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.827 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.827 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.827 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.281362_326.1", 2020-10-05T12:10:09.827 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.827 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:09.827 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.281362477Z", 2020-10-05T12:10:09.827 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.828 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.828 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:09.828 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.828 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.828 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.828 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:09.828 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.829 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.829 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.829 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.829 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.829 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.829 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.829 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.830 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.298750_327.1", 2020-10-05T12:10:09.830 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.830 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:09.830 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.298750857Z", 2020-10-05T12:10:09.830 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.831 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.831 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:09.831 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.831 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.831 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.831 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:09.832 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.832 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.832 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.832 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.832 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.833 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.833 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.833 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.833 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.311388_328.1", 2020-10-05T12:10:09.833 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.833 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:09.833 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.311388336Z", 2020-10-05T12:10:09.833 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.834 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.834 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:09.834 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.834 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.834 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.834 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:09.834 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:09.835 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.835 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.835 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.835 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.835 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.835 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.835 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.836 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899656.318021_329.1", 2020-10-05T12:10:09.836 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.836 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:09.836 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:36.318021017Z", 2020-10-05T12:10:09.836 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.836 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.836 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:09.836 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.837 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.837 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.837 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:09.837 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 3 2020-10-05T12:10:09.837 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.837 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.837 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.838 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.838 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.838 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.838 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.838 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.685537_330.1", 2020-10-05T12:10:09.838 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.838 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:09.839 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.685537275Z", 2020-10-05T12:10:09.839 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.839 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.839 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.839 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.839 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.839 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.839 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:09.840 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.840 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.840 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.840 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.840 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.840 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.840 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.841 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.841 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.689965_338.1", 2020-10-05T12:10:09.841 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.841 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:09.841 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.689965260Z", 2020-10-05T12:10:09.841 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.841 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.842 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.842 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.842 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.842 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.842 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:09.842 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.842 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.842 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.843 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.843 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.843 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.843 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.843 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.843 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.691704_339.1", 2020-10-05T12:10:09.843 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.844 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-27", 2020-10-05T12:10:09.844 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.691704538Z", 2020-10-05T12:10:09.844 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.844 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.844 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.844 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.844 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.844 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.845 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_3ghfMalV8FJvx__fjUkOrTe", 2020-10-05T12:10:09.845 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.845 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.845 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.845 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.845 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.845 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.846 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.846 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.846 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.696863_340.1", 2020-10-05T12:10:09.846 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.846 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-27", 2020-10-05T12:10:09.846 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.696863318Z", 2020-10-05T12:10:09.846 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.847 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.847 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.847 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.847 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.847 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.847 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_3ghfMalV8FJvx__fjUkOrTe", 2020-10-05T12:10:09.847 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.847 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.848 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.848 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.848 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.848 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.848 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.848 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.848 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.724232_341.1", 2020-10-05T12:10:09.849 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.849 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:09.849 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.724232023Z", 2020-10-05T12:10:09.849 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.849 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.849 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.849 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.849 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.850 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.850 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:09.850 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.850 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.850 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.850 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.850 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.851 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.851 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.851 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.851 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.729087_342.1", 2020-10-05T12:10:09.851 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.851 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:09.851 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.729087316Z", 2020-10-05T12:10:09.852 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.852 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.852 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.852 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.852 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.852 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.852 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:09.852 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.853 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.853 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.853 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.853 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.853 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.853 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.853 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.854 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.731113_343.1", 2020-10-05T12:10:09.854 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.854 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-28", 2020-10-05T12:10:09.854 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.731113851Z", 2020-10-05T12:10:09.854 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.854 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.854 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.855 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.855 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.855 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.855 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qZhqLSO2IT-th3DUT4YqnJL", 2020-10-05T12:10:09.855 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.855 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.855 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.855 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.856 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.856 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.856 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.856 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.856 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.735226_344.1", 2020-10-05T12:10:09.856 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.856 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-28", 2020-10-05T12:10:09.857 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.735226387Z", 2020-10-05T12:10:09.857 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.857 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.857 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.857 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.857 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.857 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.857 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qZhqLSO2IT-th3DUT4YqnJL", 2020-10-05T12:10:09.858 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.858 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.858 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.858 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.858 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.858 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.858 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.859 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.859 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.784620_345.1", 2020-10-05T12:10:09.859 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.859 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:09.859 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.784620187Z", 2020-10-05T12:10:09.859 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.859 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.860 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.860 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.860 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.860 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.860 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:09.860 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.860 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.861 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.861 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.861 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.861 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.861 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.861 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.861 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.790107_346.1", 2020-10-05T12:10:09.861 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.862 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:09.862 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.790107967Z", 2020-10-05T12:10:09.862 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.862 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.862 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.862 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.862 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.863 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.863 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:09.863 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.863 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.863 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.863 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.863 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.863 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.864 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.864 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.864 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.792020_347.1", 2020-10-05T12:10:09.864 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.864 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-29", 2020-10-05T12:10:09.864 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.792020540Z", 2020-10-05T12:10:09.864 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.865 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.865 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.865 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.865 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.865 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.865 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qBLhF76LBUvDFkuAku_lLJs", 2020-10-05T12:10:09.865 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.866 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.866 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.866 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.866 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.866 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.866 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.866 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.867 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.796655_348.1", 2020-10-05T12:10:09.867 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.867 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-29", 2020-10-05T12:10:09.867 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.796655308Z", 2020-10-05T12:10:09.867 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.867 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.867 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.867 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.868 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.868 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.868 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_qBLhF76LBUvDFkuAku_lLJs", 2020-10-05T12:10:09.868 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.868 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.868 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.868 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.869 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.869 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.869 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.869 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.869 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.839365_349.1", 2020-10-05T12:10:09.869 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.869 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:09.870 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.839365259Z", 2020-10-05T12:10:09.870 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.870 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.870 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:09.870 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.870 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.870 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.871 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:09.871 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.871 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.871 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.871 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.871 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.871 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.871 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.872 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.872 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.845048_350.1", 2020-10-05T12:10:09.872 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.872 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:09.872 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.845048144Z", 2020-10-05T12:10:09.872 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.872 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.873 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:09.873 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.873 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.873 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.873 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:09.873 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.873 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.874 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.874 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.874 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.874 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.874 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.874 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.874 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.892935_351.1", 2020-10-05T12:10:09.874 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.875 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:09.875 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.892935368Z", 2020-10-05T12:10:09.875 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.875 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.875 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:09.875 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.875 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.876 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.876 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:09.876 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.876 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.876 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.876 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.876 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.877 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.877 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.877 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.877 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.901826_352.1", 2020-10-05T12:10:09.877 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.877 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:09.877 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.901826223Z", 2020-10-05T12:10:09.877 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.878 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.878 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:09.878 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.878 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.878 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.878 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:09.878 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.879 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.879 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.879 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.879 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.879 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.879 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.879 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.880 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.959774_353.1", 2020-10-05T12:10:09.880 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.880 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:09.880 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.959774780Z", 2020-10-05T12:10:09.880 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.880 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.880 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:09.880 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.881 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.881 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.881 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:09.881 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.881 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.881 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.881 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.882 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.882 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.882 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.882 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.882 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899665.970218_354.1", 2020-10-05T12:10:09.882 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.882 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:09.882 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:45.970218043Z", 2020-10-05T12:10:09.883 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.883 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.883 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:09.883 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.883 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.883 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.883 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:09.884 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.884 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.884 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.884 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.884 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.884 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.884 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.884 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.885 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.042360_355.1", 2020-10-05T12:10:09.885 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.885 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:09.885 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.042360998Z", 2020-10-05T12:10:09.885 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.885 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.885 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.886 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.886 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.886 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.886 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:09.886 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.886 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.886 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.886 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.887 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.887 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.887 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.887 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.887 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.048194_356.1", 2020-10-05T12:10:09.887 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.887 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:09.888 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.048194819Z", 2020-10-05T12:10:09.888 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.888 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.888 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.888 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.888 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.888 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.888 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:09.889 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.889 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.889 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.889 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.889 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.889 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.889 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.890 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.890 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.053339_357.1", 2020-10-05T12:10:09.890 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.890 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-30", 2020-10-05T12:10:09.890 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.053339803Z", 2020-10-05T12:10:09.890 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.890 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.890 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.891 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.891 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.891 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.891 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_7U7eHcX5CMNoEpAGs_GrGNM", 2020-10-05T12:10:09.891 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.891 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.891 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.892 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.892 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.892 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.892 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.892 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.892 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.061637_358.1", 2020-10-05T12:10:09.892 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.892 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-30", 2020-10-05T12:10:09.893 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.061637328Z", 2020-10-05T12:10:09.893 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.893 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.893 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.893 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.893 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.893 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.894 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_7U7eHcX5CMNoEpAGs_GrGNM", 2020-10-05T12:10:09.894 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.894 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.894 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.894 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.894 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.894 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.895 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.895 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.895 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.082626_359.1", 2020-10-05T12:10:09.895 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.895 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:09.895 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.082626326Z", 2020-10-05T12:10:09.895 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.895 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.896 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.896 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.896 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.896 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.896 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:09.896 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.896 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.897 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.897 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.897 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.897 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.897 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.897 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.897 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.088179_360.1", 2020-10-05T12:10:09.897 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.898 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:09.898 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.088179217Z", 2020-10-05T12:10:09.898 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.898 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.898 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.898 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.898 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.899 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.899 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:09.899 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.899 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.899 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.899 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.899 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.900 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.900 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.900 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.900 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.093155_361.1", 2020-10-05T12:10:09.900 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.900 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-31", 2020-10-05T12:10:09.900 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.093155536Z", 2020-10-05T12:10:09.900 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.901 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.901 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.901 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.901 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.901 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.901 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_dG5Cl_WMxrVmCxRlv_ggf_X", 2020-10-05T12:10:09.901 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.902 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.902 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.902 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.902 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.902 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.902 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.902 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.902 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.100733_362.1", 2020-10-05T12:10:09.903 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.903 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-31", 2020-10-05T12:10:09.903 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.100733753Z", 2020-10-05T12:10:09.903 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.903 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.903 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.903 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.904 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.904 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.904 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_dG5Cl_WMxrVmCxRlv_ggf_X", 2020-10-05T12:10:09.904 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.904 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.904 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.904 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.904 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.905 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.905 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.905 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.905 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.142756_363.1", 2020-10-05T12:10:09.905 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.905 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:09.905 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.142756231Z", 2020-10-05T12:10:09.906 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.906 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.906 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.906 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.906 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.906 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.906 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:09.907 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.907 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.907 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.907 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.907 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.907 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.907 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.907 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.908 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.147332_364.1", 2020-10-05T12:10:09.908 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.908 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:09.908 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.147332504Z", 2020-10-05T12:10:09.908 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.908 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.908 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.908 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.909 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.909 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.909 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:09.909 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.909 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.909 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.909 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.910 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.910 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.910 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.910 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.910 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.149290_365.1", 2020-10-05T12:10:09.910 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.910 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-32", 2020-10-05T12:10:09.911 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.149290141Z", 2020-10-05T12:10:09.911 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.911 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.911 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.911 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.911 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.911 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.911 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_szbUgjaae7_m6uBd5TkL2Ow", 2020-10-05T12:10:09.912 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.912 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.912 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.912 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.912 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.912 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.912 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.913 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.913 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.153116_366.1", 2020-10-05T12:10:09.913 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.913 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-32", 2020-10-05T12:10:09.913 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.153116214Z", 2020-10-05T12:10:09.913 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.913 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.913 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.914 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.914 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.914 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.914 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_szbUgjaae7_m6uBd5TkL2Ow", 2020-10-05T12:10:09.914 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.914 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.914 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.915 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.915 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.915 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.915 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.915 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.915 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.177454_367.1", 2020-10-05T12:10:09.915 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.915 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:09.916 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.177454223Z", 2020-10-05T12:10:09.916 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.916 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.916 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:09.916 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.916 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.916 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.917 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:09.917 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.917 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.917 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.917 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.917 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.917 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.917 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.918 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.918 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.184234_368.1", 2020-10-05T12:10:09.918 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.918 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:09.918 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.184234806Z", 2020-10-05T12:10:09.918 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.918 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.919 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:09.919 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.919 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.919 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.919 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:09.919 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.919 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.920 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.920 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.920 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.920 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.920 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.920 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.920 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.239181_369.1", 2020-10-05T12:10:09.920 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.921 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:09.921 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.239181274Z", 2020-10-05T12:10:09.921 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.921 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.921 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:09.921 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.921 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.922 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.922 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:09.922 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.922 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.922 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.922 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.922 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.922 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.923 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.923 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.923 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.250627_370.1", 2020-10-05T12:10:09.923 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.923 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:09.923 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.250627601Z", 2020-10-05T12:10:09.923 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.924 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.924 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:09.924 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.924 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.924 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.924 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:09.924 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.924 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.925 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.925 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.925 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.925 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.925 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.925 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.925 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.330136_371.1", 2020-10-05T12:10:09.926 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.926 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:09.926 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.330136508Z", 2020-10-05T12:10:09.926 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.926 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.926 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:09.926 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.927 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.927 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.927 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:09.927 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.927 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.927 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.927 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.927 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.928 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.928 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.928 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.928 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.344671_372.1", 2020-10-05T12:10:09.928 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.928 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:09.928 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.344671408Z", 2020-10-05T12:10:09.929 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.929 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.929 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:09.929 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.929 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.929 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.929 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:09.929 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:09.930 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.930 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.930 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.930 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.930 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.930 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.930 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.931 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.409725_373.1", 2020-10-05T12:10:09.931 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.931 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:09.931 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.409725716Z", 2020-10-05T12:10:09.931 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.931 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.931 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.932 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.932 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.932 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.932 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:09.932 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.932 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.932 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.932 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.933 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.933 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.933 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.933 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.933 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.414399_374.1", 2020-10-05T12:10:09.933 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.933 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:09.934 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.414399267Z", 2020-10-05T12:10:09.934 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.934 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.934 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.934 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.934 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.934 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.934 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:09.935 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.935 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.935 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.935 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.935 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.935 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.935 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.936 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.936 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.416593_375.1", 2020-10-05T12:10:09.936 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.936 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-33", 2020-10-05T12:10:09.936 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.416593573Z", 2020-10-05T12:10:09.936 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.936 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.936 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.937 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.937 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.937 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.937 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EyrR1NPa80nMYyy_aATR-lo", 2020-10-05T12:10:09.937 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.937 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.937 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.938 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.938 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.938 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.938 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.938 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.938 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.422118_376.1", 2020-10-05T12:10:09.938 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.939 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-33", 2020-10-05T12:10:09.939 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.422118088Z", 2020-10-05T12:10:09.939 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.939 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.939 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.939 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.939 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.940 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.940 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EyrR1NPa80nMYyy_aATR-lo", 2020-10-05T12:10:09.940 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.940 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.940 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.940 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.940 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.940 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.941 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.941 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.941 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.457009_377.1", 2020-10-05T12:10:09.941 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.941 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:09.941 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.457009356Z", 2020-10-05T12:10:09.941 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.941 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.942 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.942 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.942 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.942 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.942 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:09.942 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.942 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.943 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.943 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.943 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.943 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.943 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.943 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.943 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.460962_378.1", 2020-10-05T12:10:09.944 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.944 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:09.944 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.460962760Z", 2020-10-05T12:10:09.944 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.944 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.944 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.944 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.944 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.945 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.945 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:09.945 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.945 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.945 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.945 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.945 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.946 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.946 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.946 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.946 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.462754_379.1", 2020-10-05T12:10:09.946 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.946 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-34", 2020-10-05T12:10:09.946 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.462754733Z", 2020-10-05T12:10:09.947 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.947 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.947 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.947 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.947 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.947 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.947 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_aVIFxV-3ngBmVcQFfKjSUBE", 2020-10-05T12:10:09.947 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.948 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.948 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.948 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.948 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.948 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.948 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.948 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.949 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.466366_380.1", 2020-10-05T12:10:09.949 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.949 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-34", 2020-10-05T12:10:09.949 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.466366720Z", 2020-10-05T12:10:09.949 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.949 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.949 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.949 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.950 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.950 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.950 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_aVIFxV-3ngBmVcQFfKjSUBE", 2020-10-05T12:10:09.950 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.950 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.950 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.950 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.951 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.951 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.951 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.951 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.951 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.499953_381.1", 2020-10-05T12:10:09.951 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.951 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:09.951 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.499953363Z", 2020-10-05T12:10:09.952 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.952 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.952 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.952 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.952 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.952 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.952 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:09.953 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.953 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.953 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.953 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.953 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.953 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.953 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.954 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.954 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.504875_382.1", 2020-10-05T12:10:09.954 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:09.954 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:09.954 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.504875519Z", 2020-10-05T12:10:09.954 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.954 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.954 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.955 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.955 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.955 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.955 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:09.955 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.955 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.955 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.956 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:09.956 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.956 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.956 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.956 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.956 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.507574_383.1", 2020-10-05T12:10:09.956 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.957 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-35", 2020-10-05T12:10:09.957 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.507574492Z", 2020-10-05T12:10:09.957 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.957 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.957 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.957 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.957 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.957 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.958 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_--X6GvPo7a_vb5l6gavGQUo", 2020-10-05T12:10:09.958 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:09.958 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.958 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:09.958 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:09.958 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.958 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:09.959 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.959 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:09.959 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.512697_384.1", 2020-10-05T12:10:09.959 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:09.959 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-35", 2020-10-05T12:10:09.959 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.512697176Z", 2020-10-05T12:10:09.959 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:09.960 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:09.960 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:09.960 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:09.960 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:09.960 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:09.960 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_--X6GvPo7a_vb5l6gavGQUo", 2020-10-05T12:10:10.064 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.064 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.064 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.065 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.065 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.065 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.065 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.065 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.065 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.538401_385.1", 2020-10-05T12:10:10.066 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.066 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:10.066 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.538401203Z", 2020-10-05T12:10:10.066 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.066 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.066 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:10.067 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.067 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.067 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.067 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:10.067 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:10.067 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.067 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.068 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.068 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.068 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.068 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.068 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.069 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899666.544174_386.1", 2020-10-05T12:10:10.069 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.069 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:10.069 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:46.544174292Z", 2020-10-05T12:10:10.069 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.069 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.069 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:10.069 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.070 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.070 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.070 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:10.070 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:10.070 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.070 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.070 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.071 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.071 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.071 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.071 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.071 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899667.597394_387.1", 2020-10-05T12:10:10.071 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.071 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:10.072 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:47.597394776Z", 2020-10-05T12:10:10.072 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.072 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.072 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:10.072 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.072 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.072 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.073 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:10.073 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:10.073 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.073 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.073 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.073 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.073 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.073 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.074 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.074 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899667.608381_388.1", 2020-10-05T12:10:10.074 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.074 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:10.074 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:47.608381219Z", 2020-10-05T12:10:10.074 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.074 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.075 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:10.075 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.075 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.075 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.075 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:10.075 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:10.076 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.076 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.076 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.076 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.076 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.077 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.077 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.077 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.669772_389.1", 2020-10-05T12:10:10.077 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.077 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:10.077 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.669772427Z", 2020-10-05T12:10:10.077 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.078 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.078 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:10.078 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.078 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.078 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.078 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:10.079 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:10.079 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.079 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.079 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.079 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.079 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.079 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.079 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.080 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.681403_390.1", 2020-10-05T12:10:10.080 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.080 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:10.080 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.681403105Z", 2020-10-05T12:10:10.080 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.080 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.080 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:10.081 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.081 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.081 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.081 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:10.081 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:10.081 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.081 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.082 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.082 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.082 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.082 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.082 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.082 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.755317_391.1", 2020-10-05T12:10:10.082 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.083 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-36:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.36", 2020-10-05T12:10:10.083 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.755317269Z", 2020-10-05T12:10:10.083 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.083 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.083 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.083 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.083 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.084 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.084 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_3icl_ECM1V9msMyvu87yxtG", 2020-10-05T12:10:10.084 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.084 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.084 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.084 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.084 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.085 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.085 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.085 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.085 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.760371_392.1", 2020-10-05T12:10:10.085 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.085 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-36:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.36", 2020-10-05T12:10:10.085 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.760371672Z", 2020-10-05T12:10:10.085 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.086 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.086 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.086 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.086 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.086 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.086 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_3icl_ECM1V9msMyvu87yxtG", 2020-10-05T12:10:10.086 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.087 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.087 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.087 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.087 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.087 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.087 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.087 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.088 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.762899_393.1", 2020-10-05T12:10:10.088 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.088 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-36", 2020-10-05T12:10:10.088 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.762899080Z", 2020-10-05T12:10:10.088 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.088 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.088 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.089 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.089 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.089 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.089 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_8WZRY6hDRE8a9myMhYrKAX_", 2020-10-05T12:10:10.089 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.089 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.089 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.090 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.090 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.090 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.090 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.090 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.090 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.767561_394.1", 2020-10-05T12:10:10.090 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.091 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-36", 2020-10-05T12:10:10.091 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.767561731Z", 2020-10-05T12:10:10.091 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.091 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.091 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.091 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.091 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.091 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.092 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_8WZRY6hDRE8a9myMhYrKAX_", 2020-10-05T12:10:10.092 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.092 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.092 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.092 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.092 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.092 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.093 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.093 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.093 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.797969_395.1", 2020-10-05T12:10:10.093 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.093 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-37:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.37", 2020-10-05T12:10:10.093 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.797969247Z", 2020-10-05T12:10:10.093 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.094 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.094 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.094 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.094 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.094 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.094 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rp3Sewj1i--RN9QFC9kTl1R", 2020-10-05T12:10:10.094 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.094 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.095 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.095 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.095 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.095 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.095 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.095 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.095 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.802805_396.1", 2020-10-05T12:10:10.096 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.096 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-37:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.37", 2020-10-05T12:10:10.096 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.802805288Z", 2020-10-05T12:10:10.096 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.096 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.096 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.096 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.097 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.097 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.097 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rp3Sewj1i--RN9QFC9kTl1R", 2020-10-05T12:10:10.097 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.097 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.097 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.097 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.098 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.098 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.098 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.098 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.098 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.804808_397.1", 2020-10-05T12:10:10.098 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.098 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-37", 2020-10-05T12:10:10.099 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.804808204Z", 2020-10-05T12:10:10.099 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.099 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.099 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.099 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.099 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.099 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.100 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_m6h3qoVJUfeAaOYxYpjLCny", 2020-10-05T12:10:10.100 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.100 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.100 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.100 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.100 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.100 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.101 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.101 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.101 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.808515_398.1", 2020-10-05T12:10:10.101 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.101 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-37", 2020-10-05T12:10:10.101 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.808515097Z", 2020-10-05T12:10:10.101 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.102 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.102 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.102 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.102 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.102 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.102 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_m6h3qoVJUfeAaOYxYpjLCny", 2020-10-05T12:10:10.102 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.103 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.103 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.103 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.103 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.103 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.103 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.103 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.104 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.872453_399.1", 2020-10-05T12:10:10.104 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.104 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-38:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.38", 2020-10-05T12:10:10.104 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.872453804Z", 2020-10-05T12:10:10.104 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.104 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.104 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.104 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.105 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.105 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.105 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_-HoKnRhe8TocC-rxrrEt-K9", 2020-10-05T12:10:10.105 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.105 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.105 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.105 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.106 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.106 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.106 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.106 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.106 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.876761_400.1", 2020-10-05T12:10:10.106 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.106 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-38:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.38", 2020-10-05T12:10:10.107 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.876761083Z", 2020-10-05T12:10:10.107 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.107 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.107 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.107 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.107 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.107 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.108 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_-HoKnRhe8TocC-rxrrEt-K9", 2020-10-05T12:10:10.108 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.108 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.108 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.108 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.108 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.108 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.108 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.109 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.109 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.879002_401.1", 2020-10-05T12:10:10.109 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.109 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-38", 2020-10-05T12:10:10.109 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.879002719Z", 2020-10-05T12:10:10.109 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.109 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.110 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.110 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.110 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.110 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.110 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_s0iZkzLPbkOXiRUVThv-a9T", 2020-10-05T12:10:10.110 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.110 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.111 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.111 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.111 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.111 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.111 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.111 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.111 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899668.888419_402.1", 2020-10-05T12:10:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-38", 2020-10-05T12:10:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:48.888419542Z", 2020-10-05T12:10:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.112 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.113 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.113 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_s0iZkzLPbkOXiRUVThv-a9T", 2020-10-05T12:10:10.113 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.113 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.113 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.113 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.114 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.114 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.114 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.114 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.114 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.482263_403.1", 2020-10-05T12:10:10.114 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.114 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-39:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.39", 2020-10-05T12:10:10.114 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.482263867Z", 2020-10-05T12:10:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.115 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_mBr7LUv6iNJJo-p_fWMP8K5", 2020-10-05T12:10:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.116 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.117 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.486347_405.1", 2020-10-05T12:10:10.117 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.117 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-39:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.39", 2020-10-05T12:10:10.117 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.486347434Z", 2020-10-05T12:10:10.117 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.117 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.117 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.118 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.118 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.118 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.118 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_mBr7LUv6iNJJo-p_fWMP8K5", 2020-10-05T12:10:10.118 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.118 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.118 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.119 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.119 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.119 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.119 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.119 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.119 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.488367_406.1", 2020-10-05T12:10:10.119 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.120 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-39", 2020-10-05T12:10:10.120 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.488367312Z", 2020-10-05T12:10:10.120 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.120 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.120 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.120 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.120 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.120 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.121 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_xFlhJ327xLR_penGucomc8D", 2020-10-05T12:10:10.121 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.121 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.121 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.121 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.121 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.121 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.122 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.122 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.122 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.492419_407.1", 2020-10-05T12:10:10.122 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.122 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-39", 2020-10-05T12:10:10.122 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.492419420Z", 2020-10-05T12:10:10.122 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.122 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.123 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.123 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.123 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.123 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.123 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_xFlhJ327xLR_penGucomc8D", 2020-10-05T12:10:10.123 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.123 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.124 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.124 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.124 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.124 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.124 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.124 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.124 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.523672_408.1", 2020-10-05T12:10:10.125 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.125 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-40:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.40", 2020-10-05T12:10:10.125 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.523672589Z", 2020-10-05T12:10:10.125 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.125 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.125 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.125 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.126 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.126 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.126 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_M4WWBNi5IJ-RWpNAHhcS0lG", 2020-10-05T12:10:10.126 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.126 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.126 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.126 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.127 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.127 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.127 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.127 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.127 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.528666_409.1", 2020-10-05T12:10:10.127 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.127 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-40:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.40", 2020-10-05T12:10:10.127 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.528666589Z", 2020-10-05T12:10:10.128 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.128 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.128 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.128 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.128 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.128 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.128 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_M4WWBNi5IJ-RWpNAHhcS0lG", 2020-10-05T12:10:10.129 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.129 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.129 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.129 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.129 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.129 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.129 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.129 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.130 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.533845_410.1", 2020-10-05T12:10:10.130 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.130 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-40", 2020-10-05T12:10:10.130 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.533845466Z", 2020-10-05T12:10:10.130 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.130 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.130 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.131 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.131 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.131 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.131 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gWvQIgj3cIEvwYjW0hD1OuM", 2020-10-05T12:10:10.131 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.131 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.131 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.132 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.132 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.132 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.132 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.132 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.132 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.541752_411.1", 2020-10-05T12:10:10.132 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.132 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-40", 2020-10-05T12:10:10.133 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.541752331Z", 2020-10-05T12:10:10.133 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.133 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.133 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.133 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.133 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.133 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.134 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_gWvQIgj3cIEvwYjW0hD1OuM", 2020-10-05T12:10:10.134 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.134 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.134 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.134 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.134 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.134 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.135 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.135 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.135 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.597447_412.1", 2020-10-05T12:10:10.135 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.135 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-41:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.41", 2020-10-05T12:10:10.135 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.597447087Z", 2020-10-05T12:10:10.135 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.135 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.136 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.136 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.136 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.136 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.136 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_eaDHMmwfm1xaPKhMWupCPOl", 2020-10-05T12:10:10.136 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.136 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.137 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.137 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.137 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.137 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.137 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.137 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.137 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.602294_413.1", 2020-10-05T12:10:10.138 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.138 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-41:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.41", 2020-10-05T12:10:10.138 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.602294636Z", 2020-10-05T12:10:10.138 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.138 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.138 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.138 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.139 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.139 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.139 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_eaDHMmwfm1xaPKhMWupCPOl", 2020-10-05T12:10:10.139 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.139 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.139 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.139 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.140 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.140 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.140 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.140 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.140 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.604098_414.1", 2020-10-05T12:10:10.140 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.140 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-41", 2020-10-05T12:10:10.140 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.604098679Z", 2020-10-05T12:10:10.141 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.141 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.141 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.141 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.141 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.141 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.141 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Qk4kFwtlsplX3FbEXjLvzNg", 2020-10-05T12:10:10.142 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.142 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.142 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.142 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.142 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.142 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.142 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.143 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.143 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899670.607428_415.1", 2020-10-05T12:10:10.143 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.143 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-41", 2020-10-05T12:10:10.143 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.607428984Z", 2020-10-05T12:10:10.143 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.143 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.144 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.144 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.144 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.144 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.144 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Qk4kFwtlsplX3FbEXjLvzNg", 2020-10-05T12:10:10.144 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.144 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.144 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.145 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.145 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.145 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.145 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.145 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.145 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.309220_45.1", 2020-10-05T12:10:10.145 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.146 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-1:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.1", 2020-10-05T12:10:10.146 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.309220986Z", 2020-10-05T12:10:10.146 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.146 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.146 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.146 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.146 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.147 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.147 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_yW5321q_H3rgrXH_8hp_2oS", 2020-10-05T12:10:10.147 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.147 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.147 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.147 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.147 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.147 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.148 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.148 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.148 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.323188_52.1", 2020-10-05T12:10:10.148 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.148 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-1:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.1", 2020-10-05T12:10:10.148 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.323188619Z", 2020-10-05T12:10:10.148 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.149 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.149 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.149 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.149 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.149 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.149 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_yW5321q_H3rgrXH_8hp_2oS", 2020-10-05T12:10:10.149 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.150 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.150 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.150 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.150 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.150 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.150 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.150 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.150 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.324606_53.1", 2020-10-05T12:10:10.151 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.151 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-1", 2020-10-05T12:10:10.151 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.324606525Z", 2020-10-05T12:10:10.151 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.151 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.151 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.151 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.152 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.152 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.152 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_O5mZZC9qWHtFDZP9jX8TRT7", 2020-10-05T12:10:10.152 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.152 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.152 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.152 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.153 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.153 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.153 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.153 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.153 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.330398_54.1", 2020-10-05T12:10:10.153 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.154 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-1", 2020-10-05T12:10:10.154 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.330398615Z", 2020-10-05T12:10:10.154 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.154 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.154 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.154 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.154 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.154 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.155 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_O5mZZC9qWHtFDZP9jX8TRT7", 2020-10-05T12:10:10.155 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.155 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.155 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.155 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.155 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.156 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.156 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.156 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.156 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.352875_55.1", 2020-10-05T12:10:10.156 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.156 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-2:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.2", 2020-10-05T12:10:10.156 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.352875916Z", 2020-10-05T12:10:10.157 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.157 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.157 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.157 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.157 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.157 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.157 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_jFiFlBW0gJEjys5t9-_iV1V", 2020-10-05T12:10:10.158 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.158 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.158 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.158 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.158 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.158 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.159 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.159 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.159 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.359690_56.1", 2020-10-05T12:10:10.159 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.159 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-2:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.2", 2020-10-05T12:10:10.159 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.359690270Z", 2020-10-05T12:10:10.159 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.160 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.160 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.160 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.160 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.160 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.160 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_jFiFlBW0gJEjys5t9-_iV1V", 2020-10-05T12:10:10.160 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.160 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.161 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.161 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.161 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.161 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.161 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.161 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.161 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.362078_57.1", 2020-10-05T12:10:10.162 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.162 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-2", 2020-10-05T12:10:10.162 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.362078463Z", 2020-10-05T12:10:10.162 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.162 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.162 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.162 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.163 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.163 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.163 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_WwokRaHlmdENZ_Gh_tirmfG", 2020-10-05T12:10:10.163 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.163 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.163 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.163 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.163 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.164 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.164 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.164 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.164 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899133.372604_58.1", 2020-10-05T12:10:10.164 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.164 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-2", 2020-10-05T12:10:10.164 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:53.372604328Z", 2020-10-05T12:10:10.165 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.165 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.165 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.165 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.165 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.165 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.165 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_WwokRaHlmdENZ_Gh_tirmfG", 2020-10-05T12:10:10.166 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.166 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.166 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.166 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.166 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.166 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.166 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.166 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.167 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899136.699771_60.1", 2020-10-05T12:10:10.167 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.167 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-3:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.3", 2020-10-05T12:10:10.167 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:56.699771738Z", 2020-10-05T12:10:10.167 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.167 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.168 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.168 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.168 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.168 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.168 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rmwjFru8PLxDCA-VIsNWDx7", 2020-10-05T12:10:10.168 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.168 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.169 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.169 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.169 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.169 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.169 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.169 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.169 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899136.704901_61.1", 2020-10-05T12:10:10.169 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.170 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-3:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.3", 2020-10-05T12:10:10.170 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:56.704901138Z", 2020-10-05T12:10:10.170 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.170 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.170 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.170 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.170 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.171 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.171 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rmwjFru8PLxDCA-VIsNWDx7", 2020-10-05T12:10:10.171 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.171 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.171 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.171 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.171 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.172 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.172 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.172 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.172 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899136.707633_62.1", 2020-10-05T12:10:10.172 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.172 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-3", 2020-10-05T12:10:10.172 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:56.707633249Z", 2020-10-05T12:10:10.172 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.173 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.173 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.173 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.173 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.173 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.173 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Ae2fl6vm7rY1i6OtshHDi2X", 2020-10-05T12:10:10.173 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.174 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.174 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.174 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.174 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.174 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.174 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.174 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.175 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899136.712011_63.1", 2020-10-05T12:10:10.175 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.175 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-3", 2020-10-05T12:10:10.175 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:56.712011683Z", 2020-10-05T12:10:10.175 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.175 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.175 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.176 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.176 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.176 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.176 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Ae2fl6vm7rY1i6OtshHDi2X", 2020-10-05T12:10:10.176 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.176 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.176 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.176 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.177 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.177 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.177 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.177 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.177 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899137.978801_67.1", 2020-10-05T12:10:10.177 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.177 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-4:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.4", 2020-10-05T12:10:10.178 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:57.978801960Z", 2020-10-05T12:10:10.178 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.178 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.178 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.178 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.178 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.178 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.179 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_R9cr1AM7-ROLCvUODxti2Hy", 2020-10-05T12:10:10.179 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.179 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.179 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.179 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.179 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.179 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.180 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.180 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.180 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899137.983575_68.1", 2020-10-05T12:10:10.180 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.180 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-4:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.4", 2020-10-05T12:10:10.180 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:57.983575708Z", 2020-10-05T12:10:10.180 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.181 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.181 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.181 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.181 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.181 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.181 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_R9cr1AM7-ROLCvUODxti2Hy", 2020-10-05T12:10:10.181 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.182 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.182 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.182 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.182 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.182 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.182 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.182 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.183 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899137.985378_69.1", 2020-10-05T12:10:10.183 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.183 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-4", 2020-10-05T12:10:10.183 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:57.985378089Z", 2020-10-05T12:10:10.183 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.183 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.183 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.183 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.184 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.184 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.184 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_L7bOK0Z4V74uuwLURFH192I", 2020-10-05T12:10:10.184 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.184 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.184 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.184 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.185 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.185 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.185 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.185 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.185 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899137.989603_70.1", 2020-10-05T12:10:10.185 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.185 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-4", 2020-10-05T12:10:10.185 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:57.989603894Z", 2020-10-05T12:10:10.186 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.186 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.186 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.186 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.186 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.186 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.186 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_L7bOK0Z4V74uuwLURFH192I", 2020-10-05T12:10:10.187 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.187 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.187 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.187 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.187 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.187 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.187 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.187 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.188 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.008931_71.1", 2020-10-05T12:10:10.188 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.188 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-5:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.5", 2020-10-05T12:10:10.188 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.008931512Z", 2020-10-05T12:10:10.188 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.188 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.188 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.189 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.189 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.189 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.189 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_mFQkTXg1VqZK7t8XsW9miUA", 2020-10-05T12:10:10.189 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.189 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.189 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.190 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.190 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.190 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.190 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.190 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.190 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.013300_72.1", 2020-10-05T12:10:10.190 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.190 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-5:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.5", 2020-10-05T12:10:10.191 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.013300296Z", 2020-10-05T12:10:10.191 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.191 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.191 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.191 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.191 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.191 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.192 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_mFQkTXg1VqZK7t8XsW9miUA", 2020-10-05T12:10:10.192 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.192 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.192 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.192 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.192 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.192 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.192 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.193 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.193 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.015249_73.1", 2020-10-05T12:10:10.193 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.193 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-5", 2020-10-05T12:10:10.193 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.015249875Z", 2020-10-05T12:10:10.193 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.193 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.194 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.194 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.194 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.194 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.194 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_SdAKsFkJizj_YE8B3JhFv3K", 2020-10-05T12:10:10.194 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.194 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.195 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.195 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.195 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.195 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.195 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.195 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.195 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.019329_74.1", 2020-10-05T12:10:10.195 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.196 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-5", 2020-10-05T12:10:10.196 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.019329476Z", 2020-10-05T12:10:10.196 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.196 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.196 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.196 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.197 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.197 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.197 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_SdAKsFkJizj_YE8B3JhFv3K", 2020-10-05T12:10:10.197 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.197 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.197 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.197 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.198 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.198 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.198 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.198 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.198 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.062991_75.1", 2020-10-05T12:10:10.198 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.198 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-6:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.6", 2020-10-05T12:10:10.199 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.062991051Z", 2020-10-05T12:10:10.199 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.199 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.199 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.199 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.199 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.199 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.200 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_h3WoSQnsgDcU-Zg3rO1vbjh", 2020-10-05T12:10:10.200 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.200 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.200 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.200 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.200 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.200 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.200 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.201 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.201 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.067217_76.1", 2020-10-05T12:10:10.201 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.201 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-6:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.6", 2020-10-05T12:10:10.201 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.067217484Z", 2020-10-05T12:10:10.201 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.201 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.202 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.202 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.202 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.202 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.202 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_h3WoSQnsgDcU-Zg3rO1vbjh", 2020-10-05T12:10:10.202 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.202 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.202 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.203 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.203 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.203 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.203 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.203 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.203 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.069962_77.1", 2020-10-05T12:10:10.203 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.204 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-6", 2020-10-05T12:10:10.204 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.069962715Z", 2020-10-05T12:10:10.204 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.204 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.204 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.204 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.204 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.205 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.205 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_au9QcNPZmxYIo3XlQDwiive", 2020-10-05T12:10:10.205 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.205 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.205 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.205 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.205 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.205 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.206 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.206 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.206 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899138.076875_78.1", 2020-10-05T12:10:10.206 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.206 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-6", 2020-10-05T12:10:10.206 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:58:58.076875124Z", 2020-10-05T12:10:10.206 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.207 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.207 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.207 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.207 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.207 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.207 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_au9QcNPZmxYIo3XlQDwiive", 2020-10-05T12:10:10.207 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.208 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.208 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.208 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.208 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.208 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.208 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.208 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.208 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.926594_79.1", 2020-10-05T12:10:10.209 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.209 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-7:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.7", 2020-10-05T12:10:10.209 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.926594218Z", 2020-10-05T12:10:10.209 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.209 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.209 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.209 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.210 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.210 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.210 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cPLQuBKjrWMkd6tqHbbfy0H", 2020-10-05T12:10:10.210 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.210 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.210 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.210 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.210 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.211 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.211 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.211 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.211 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.931290_84.1", 2020-10-05T12:10:10.211 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.211 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-7:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.7", 2020-10-05T12:10:10.211 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.931290785Z", 2020-10-05T12:10:10.212 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.212 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.212 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.212 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.212 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.212 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.212 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_cPLQuBKjrWMkd6tqHbbfy0H", 2020-10-05T12:10:10.213 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.213 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.213 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.213 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.213 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.213 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.213 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.214 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.214 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.933342_85.1", 2020-10-05T12:10:10.214 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.214 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-7", 2020-10-05T12:10:10.214 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.933342285Z", 2020-10-05T12:10:10.214 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.214 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.215 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.215 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.215 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.215 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.215 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:10.215 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.215 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.215 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.216 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.216 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.216 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.216 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.216 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.216 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.939592_86.1", 2020-10-05T12:10:10.216 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.217 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-7", 2020-10-05T12:10:10.217 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.939592960Z", 2020-10-05T12:10:10.217 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.217 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.217 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.217 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.217 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.217 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.218 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:10.218 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.218 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.218 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.218 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.218 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.218 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.219 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.219 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.219 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.961360_87.1", 2020-10-05T12:10:10.219 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.219 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-8:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.8", 2020-10-05T12:10:10.219 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.961360327Z", 2020-10-05T12:10:10.219 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.220 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.220 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.220 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.220 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.220 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.220 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_VfDg-vSGbYSY-RkVKPKcS4N", 2020-10-05T12:10:10.220 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.220 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.221 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.221 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.221 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.221 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.221 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.221 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.221 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.966517_88.1", 2020-10-05T12:10:10.222 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.222 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-8:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.8", 2020-10-05T12:10:10.222 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.966517542Z", 2020-10-05T12:10:10.222 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.222 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.222 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.222 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.222 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.223 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.223 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_VfDg-vSGbYSY-RkVKPKcS4N", 2020-10-05T12:10:10.223 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.223 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.223 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.223 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.223 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.224 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.224 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.224 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.224 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.970413_89.1", 2020-10-05T12:10:10.224 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.224 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-8", 2020-10-05T12:10:10.224 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.970413680Z", 2020-10-05T12:10:10.225 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.225 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.225 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.225 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.225 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.225 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.225 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:10.226 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.226 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.226 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.226 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.226 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.226 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.226 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.226 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.227 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899140.978679_90.1", 2020-10-05T12:10:10.227 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.227 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-8", 2020-10-05T12:10:10.227 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:00.978679498Z", 2020-10-05T12:10:10.227 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.227 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.227 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.228 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.228 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.228 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.228 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:10.228 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.228 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.228 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.228 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.229 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.229 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.229 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.229 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.229 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899141.016163_91.1", 2020-10-05T12:10:10.229 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.229 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-9:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.9", 2020-10-05T12:10:10.230 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:01.016163231Z", 2020-10-05T12:10:10.230 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.230 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.230 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.230 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.230 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.230 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.231 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Du3Kn9J3DjlCQqjeBWYnZfm", 2020-10-05T12:10:10.231 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.231 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.231 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.231 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.231 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.232 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.232 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.232 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.232 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899141.026253_92.1", 2020-10-05T12:10:10.232 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.232 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-9:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.9", 2020-10-05T12:10:10.233 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:01.026253368Z", 2020-10-05T12:10:10.233 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.233 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.233 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.233 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.233 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.233 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.234 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Du3Kn9J3DjlCQqjeBWYnZfm", 2020-10-05T12:10:10.234 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.234 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.234 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.234 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.234 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.234 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.234 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.235 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.235 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899141.029629_93.1", 2020-10-05T12:10:10.235 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.235 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-9", 2020-10-05T12:10:10.235 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:01.029629977Z", 2020-10-05T12:10:10.235 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.235 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.236 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.236 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.236 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.236 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.236 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:10.236 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.236 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.237 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.237 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:10.237 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.237 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.237 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.237 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.237 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899141.037160_94.1", 2020-10-05T12:10:10.238 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.238 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-9", 2020-10-05T12:10:10.238 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:01.037160652Z", 2020-10-05T12:10:10.238 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.238 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.238 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:10.238 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:10.239 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.239 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.239 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:10.239 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.239 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.239 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.239 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.239 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.240 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.240 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.240 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.240 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899142.364959_95.1", 2020-10-05T12:10:10.240 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.240 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-7", 2020-10-05T12:10:10.240 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.364959162Z", 2020-10-05T12:10:10.241 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.241 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.241 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:10.241 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.241 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.241 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.241 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:10.241 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:10.242 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.242 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.242 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "remove" 2020-10-05T12:10:10.242 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.242 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.242 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.242 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.243 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899142.371195_98.1", 2020-10-05T12:10:10.243 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.243 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-7", 2020-10-05T12:10:10.243 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.371195860Z", 2020-10-05T12:10:10.243 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.243 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.243 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:10.243 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.244 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.244 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.244 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:10.244 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:10.244 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.244 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.244 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.245 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.245 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.245 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.245 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.245 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899142.428255_99.1", 2020-10-05T12:10:10.245 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.245 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-8", 2020-10-05T12:10:10.245 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.428255930Z", 2020-10-05T12:10:10.246 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.246 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.246 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:10.246 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.246 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.246 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.246 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:10.247 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:10.247 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.247 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.247 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "remove" 2020-10-05T12:10:10.247 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.247 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.247 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.247 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.248 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899142.434846_100.1", 2020-10-05T12:10:10.248 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.248 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-8", 2020-10-05T12:10:10.248 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.434846076Z", 2020-10-05T12:10:10.248 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.248 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.249 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:10.249 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.249 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.249 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.249 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:10.249 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:10.249 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.249 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.250 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.250 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.250 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.250 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.250 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.250 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899142.528196_101.1", 2020-10-05T12:10:10.250 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.251 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-9", 2020-10-05T12:10:10.251 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.528196199Z", 2020-10-05T12:10:10.251 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.251 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.251 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:10.251 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.251 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.252 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.252 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:10.252 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:10.252 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.252 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.252 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "remove" 2020-10-05T12:10:10.252 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.252 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.253 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.253 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:10.253 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899142.535244_102.1", 2020-10-05T12:10:10.253 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:10.253 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-9", 2020-10-05T12:10:10.253 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244574Z", 2020-10-05T12:10:10.253 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:10.254 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:10.254 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:10.254 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:10.254 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.254 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:10.254 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:10.254 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 2 2020-10-05T12:10:10.255 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:10.255 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:10.255 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:10.255 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.255 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.255 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:10.255 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:10:10.257 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:10.257 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:10.258 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period eb044115-4632-4a42-8790-5052d87ef1c6 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:10.295 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:10.296 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:10.530 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2020-10-05T12:10:10.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.531 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899010.522064_46.1", 2020-10-05T12:10:10.531 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "user", 2020-10-05T12:10:10.531 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw-multisite-test-user", 2020-10-05T12:10:10.531 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.522064827Z", 2020-10-05T12:10:10.531 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.531 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.532 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.532 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.532 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.532 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_XfLljzuaU2vSQ_l6_rZc8Jd", 2020-10-05T12:10:10.532 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.533 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.533 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.534 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899010.531704_48.1", 2020-10-05T12:10:10.534 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "user", 2020-10-05T12:10:10.534 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw-multisite-test-user", 2020-10-05T12:10:10.534 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:56:50.531704315Z", 2020-10-05T12:10:10.534 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.534 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.535 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.535 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_XfLljzuaU2vSQ_l6_rZc8Jd", 2020-10-05T12:10:10.536 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.536 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.536 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.536 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.537 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.814004_49.1", 2020-10-05T12:10:10.537 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.537 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-10:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.10", 2020-10-05T12:10:10.537 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.814004723Z", 2020-10-05T12:10:10.537 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.537 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.538 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.538 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.538 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.538 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_OUeyPbMbUBT7BQCU4es-77f", 2020-10-05T12:10:10.538 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.539 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.539 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.539 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.820735_57.1", 2020-10-05T12:10:10.539 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.540 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-10:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.10", 2020-10-05T12:10:10.540 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.820735262Z", 2020-10-05T12:10:10.540 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.540 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.540 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.540 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.541 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_OUeyPbMbUBT7BQCU4es-77f", 2020-10-05T12:10:10.541 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.541 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.541 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.542 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.824910_58.1", 2020-10-05T12:10:10.542 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.542 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-10", 2020-10-05T12:10:10.542 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.824910635Z", 2020-10-05T12:10:10.543 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.543 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.543 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.543 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.543 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.543 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_0Xb0nTNWivrWvWx3oeYmdD5", 2020-10-05T12:10:10.543 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.544 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.544 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.545 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.833730_59.1", 2020-10-05T12:10:10.545 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.545 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-10", 2020-10-05T12:10:10.545 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.833730650Z", 2020-10-05T12:10:10.545 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.545 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.545 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.546 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.546 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_0Xb0nTNWivrWvWx3oeYmdD5", 2020-10-05T12:10:10.547 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.547 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.547 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.548 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.857632_61.1", 2020-10-05T12:10:10.548 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.548 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-11:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.11", 2020-10-05T12:10:10.549 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.857632138Z", 2020-10-05T12:10:10.549 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.549 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.549 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.549 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.549 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.550 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_v4mkZAXP0-Rav1j3dZSpNti", 2020-10-05T12:10:10.550 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.550 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.550 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.551 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.862394_62.1", 2020-10-05T12:10:10.551 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.551 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-11:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.11", 2020-10-05T12:10:10.551 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.862394648Z", 2020-10-05T12:10:10.551 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.552 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.552 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.552 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.552 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.552 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_v4mkZAXP0-Rav1j3dZSpNti", 2020-10-05T12:10:10.552 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.553 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.553 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.553 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.864807_63.1", 2020-10-05T12:10:10.554 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.554 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-11", 2020-10-05T12:10:10.554 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.864807231Z", 2020-10-05T12:10:10.554 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.554 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.554 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.554 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.555 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.555 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_L1Lb50oCzKfeW6cLgFCXcoO", 2020-10-05T12:10:10.555 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.555 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.555 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.557 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.872602_64.1", 2020-10-05T12:10:10.557 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.557 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-11", 2020-10-05T12:10:10.557 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.872602240Z", 2020-10-05T12:10:10.557 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.557 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.557 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.558 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.558 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.558 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_L1Lb50oCzKfeW6cLgFCXcoO", 2020-10-05T12:10:10.558 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.558 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.559 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.559 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.914339_65.1", 2020-10-05T12:10:10.559 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.559 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-12:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.12", 2020-10-05T12:10:10.560 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.914339616Z", 2020-10-05T12:10:10.560 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.560 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.560 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.560 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.560 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.561 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_KBFql2QH92IFaRoA6pUczcF", 2020-10-05T12:10:10.561 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.561 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.561 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.562 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.918665_66.1", 2020-10-05T12:10:10.562 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.562 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-12:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.12", 2020-10-05T12:10:10.562 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.918665490Z", 2020-10-05T12:10:10.562 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.563 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.563 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.563 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_KBFql2QH92IFaRoA6pUczcF", 2020-10-05T12:10:10.564 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.564 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.564 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.565 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.920603_67.1", 2020-10-05T12:10:10.565 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.565 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-12", 2020-10-05T12:10:10.565 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.920603439Z", 2020-10-05T12:10:10.565 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.565 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.565 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.566 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.566 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.567 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_TSIbo46j-8sw-hblvAeS41m", 2020-10-05T12:10:10.567 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.568 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.568 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.569 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899143.924911_68.1", 2020-10-05T12:10:10.569 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.569 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-12", 2020-10-05T12:10:10.569 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:03.924911466Z", 2020-10-05T12:10:10.569 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.569 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.570 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.570 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.570 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.570 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_TSIbo46j-8sw-hblvAeS41m", 2020-10-05T12:10:10.570 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.571 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.571 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.572 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.705730_167.1", 2020-10-05T12:10:10.572 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.572 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-13:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.13", 2020-10-05T12:10:10.572 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.705730871Z", 2020-10-05T12:10:10.572 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.573 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.573 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.573 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.573 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.573 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_fKSRurQRBwqim7c5GEU0PUo", 2020-10-05T12:10:10.574 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.574 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.574 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.575 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.709947_170.1", 2020-10-05T12:10:10.575 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.575 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-13:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.13", 2020-10-05T12:10:10.575 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.709947223Z", 2020-10-05T12:10:10.575 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.576 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.576 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.576 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.576 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.576 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_fKSRurQRBwqim7c5GEU0PUo", 2020-10-05T12:10:10.577 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.577 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.578 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.579 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.711830_171.1", 2020-10-05T12:10:10.579 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.579 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-13", 2020-10-05T12:10:10.579 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.711830069Z", 2020-10-05T12:10:10.579 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.579 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.580 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.580 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_6qCjZsmNHmFw8bpyRgfhvgp", 2020-10-05T12:10:10.580 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.581 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.581 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.582 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.715644_172.1", 2020-10-05T12:10:10.582 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.582 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-13", 2020-10-05T12:10:10.582 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.715644136Z", 2020-10-05T12:10:10.582 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.582 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.583 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.583 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.583 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.583 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_6qCjZsmNHmFw8bpyRgfhvgp", 2020-10-05T12:10:10.583 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.584 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.584 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.735814_173.1", 2020-10-05T12:10:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-14:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.14", 2020-10-05T12:10:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.735814205Z", 2020-10-05T12:10:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_4DMFEEdE_URAKSdIzf9-FJr", 2020-10-05T12:10:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.740366_174.1", 2020-10-05T12:10:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-14:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.14", 2020-10-05T12:10:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.740366438Z", 2020-10-05T12:10:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_4DMFEEdE_URAKSdIzf9-FJr", 2020-10-05T12:10:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.743243_175.1", 2020-10-05T12:10:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-14", 2020-10-05T12:10:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.743243682Z", 2020-10-05T12:10:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UIQfkMuDK3qo2qDganeuBr3", 2020-10-05T12:10:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.748706_176.1", 2020-10-05T12:10:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-14", 2020-10-05T12:10:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.748706141Z", 2020-10-05T12:10:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UIQfkMuDK3qo2qDganeuBr3", 2020-10-05T12:10:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.597 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.597 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.800203_177.1", 2020-10-05T12:10:10.598 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.598 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-15:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.15", 2020-10-05T12:10:10.599 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.800203983Z", 2020-10-05T12:10:10.599 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.599 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.599 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.600 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.600 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_3-e1Ii4K_TT4M1zQxUiOW6q", 2020-10-05T12:10:10.600 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.600 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.601 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.601 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.807858_178.1", 2020-10-05T12:10:10.602 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.602 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-15:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.15", 2020-10-05T12:10:10.602 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.807858930Z", 2020-10-05T12:10:10.602 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.602 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.602 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.603 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_3-e1Ii4K_TT4M1zQxUiOW6q", 2020-10-05T12:10:10.603 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.603 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.603 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.604 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.604 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.604 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.810402_179.1", 2020-10-05T12:10:10.605 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.605 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-15", 2020-10-05T12:10:10.605 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.810402748Z", 2020-10-05T12:10:10.605 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.605 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.605 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.606 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.607 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.607 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pIn_cx-kgGjdDSA4gCi-AHV", 2020-10-05T12:10:10.607 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.608 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.608 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.610 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899154.815329_180.1", 2020-10-05T12:10:10.610 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-15", 2020-10-05T12:10:10.611 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:14.815329634Z", 2020-10-05T12:10:10.611 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.611 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.612 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.613 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pIn_cx-kgGjdDSA4gCi-AHV", 2020-10-05T12:10:10.613 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.614 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.614 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.615 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.087142_206.1", 2020-10-05T12:10:10.616 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.616 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:10.616 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.087142258Z", 2020-10-05T12:10:10.617 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.617 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.617 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.618 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.618 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:10.619 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.619 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.620 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.621 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.092441_208.1", 2020-10-05T12:10:10.621 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.621 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:10.622 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.092441445Z", 2020-10-05T12:10:10.622 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.622 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.623 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.623 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.624 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:10.624 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.625 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.625 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.626 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.094590_209.1", 2020-10-05T12:10:10.627 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.627 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-16", 2020-10-05T12:10:10.627 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.094590609Z", 2020-10-05T12:10:10.628 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.628 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.628 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.628 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.629 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.629 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_19VzZjSbKDNxSKagtOnJpeP", 2020-10-05T12:10:10.630 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.630 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.630 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.632 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.098781_210.1", 2020-10-05T12:10:10.632 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.632 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-16", 2020-10-05T12:10:10.633 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.098781140Z", 2020-10-05T12:10:10.633 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.633 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.634 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.634 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.635 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_19VzZjSbKDNxSKagtOnJpeP", 2020-10-05T12:10:10.635 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.636 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.636 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.637 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.123698_211.1", 2020-10-05T12:10:10.638 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.638 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:10.638 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.123698075Z", 2020-10-05T12:10:10.638 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.639 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.639 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.639 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.640 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:10.640 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.641 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.641 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.643 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.128567_212.1", 2020-10-05T12:10:10.643 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.643 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:10.644 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.128567062Z", 2020-10-05T12:10:10.644 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.644 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.644 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.645 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.645 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.645 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:10.646 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.646 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.647 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.648 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.130568_213.1", 2020-10-05T12:10:10.648 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.649 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-17", 2020-10-05T12:10:10.649 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.130568070Z", 2020-10-05T12:10:10.649 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.649 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.650 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.651 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q4C4WlcctcpJbNFl9-F-oBc", 2020-10-05T12:10:10.651 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.652 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.652 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.654 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.134679_214.1", 2020-10-05T12:10:10.654 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.654 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-17", 2020-10-05T12:10:10.654 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.134679951Z", 2020-10-05T12:10:10.655 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.655 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.656 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.657 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.657 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q4C4WlcctcpJbNFl9-F-oBc", 2020-10-05T12:10:10.657 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.658 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.658 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.658 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.176345_215.1", 2020-10-05T12:10:10.659 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.659 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:10.659 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.176345246Z", 2020-10-05T12:10:10.659 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.659 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.659 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.660 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:10.660 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.660 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.661 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.661 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.181063_216.1", 2020-10-05T12:10:10.661 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.662 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:10.662 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.181063933Z", 2020-10-05T12:10:10.662 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.662 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.662 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.663 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.663 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.663 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:10.663 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.663 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.664 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.664 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.183114_217.1", 2020-10-05T12:10:10.664 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.664 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-18", 2020-10-05T12:10:10.665 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.183114762Z", 2020-10-05T12:10:10.665 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.665 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.665 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.665 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.666 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.666 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rsmMMhH9J_A9xJxzE-ZmVue", 2020-10-05T12:10:10.666 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.666 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.666 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.667 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.187062_218.1", 2020-10-05T12:10:10.667 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.667 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-18", 2020-10-05T12:10:10.667 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.187062554Z", 2020-10-05T12:10:10.668 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.668 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.668 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.668 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.668 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.668 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rsmMMhH9J_A9xJxzE-ZmVue", 2020-10-05T12:10:10.669 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.669 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.669 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.670 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.209336_219.1", 2020-10-05T12:10:10.670 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.670 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:10.670 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.209336756Z", 2020-10-05T12:10:10.670 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.670 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.671 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:10.671 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.671 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.671 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:10.671 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.672 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.672 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.672 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.221609_220.1", 2020-10-05T12:10:10.673 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.673 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-16:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.16", 2020-10-05T12:10:10.673 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.221609923Z", 2020-10-05T12:10:10.673 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.673 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:10.673 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.674 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.674 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_iWaRl6D2_Rl91YhptgUyMhL", 2020-10-05T12:10:10.674 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.674 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.674 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.675 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.229421_221.1", 2020-10-05T12:10:10.675 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.675 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:10.676 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.229421160Z", 2020-10-05T12:10:10.676 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.676 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.676 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:10.676 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.677 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.677 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:10.677 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.677 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.677 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.678 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.237256_222.1", 2020-10-05T12:10:10.678 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.678 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-17:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.17", 2020-10-05T12:10:10.678 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.237256353Z", 2020-10-05T12:10:10.679 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.679 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:10.679 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.679 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UZ_1vmkMV4mwneY4xxqVGzP", 2020-10-05T12:10:10.679 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.680 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.680 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.681 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.249534_223.1", 2020-10-05T12:10:10.681 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.681 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:10.681 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.249534958Z", 2020-10-05T12:10:10.681 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.681 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:10.682 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.682 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.682 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:10.682 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.682 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.682 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.683 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899209.261322_224.1", 2020-10-05T12:10:10.683 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.684 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-18:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.18", 2020-10-05T12:10:10.684 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:00:09.261322106Z", 2020-10-05T12:10:10.684 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.684 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.684 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:10.684 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.685 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.685 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pnfhazlbs2VFJgLst_FAbjO", 2020-10-05T12:10:10.685 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.685 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.685 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.686 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899381.978408_225.1", 2020-10-05T12:10:10.686 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.686 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:10.686 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:01.978408731Z", 2020-10-05T12:10:10.687 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.687 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.687 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.687 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:10.687 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.688 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.688 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.689 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899381.982368_241.1", 2020-10-05T12:10:10.689 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.689 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:10.689 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:01.982368788Z", 2020-10-05T12:10:10.689 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.689 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.690 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.690 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.690 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.690 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:10.690 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.691 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.691 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.691 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899381.984906_242.1", 2020-10-05T12:10:10.692 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.692 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-19", 2020-10-05T12:10:10.692 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:01.984906741Z", 2020-10-05T12:10:10.692 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.692 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.693 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.693 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_xxeD7TssMyWfSY39I2Qdo-t", 2020-10-05T12:10:10.693 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.694 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.694 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.694 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.695 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899381.988824_243.1", 2020-10-05T12:10:10.695 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.695 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-19", 2020-10-05T12:10:10.695 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:01.988824875Z", 2020-10-05T12:10:10.695 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.695 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.695 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.696 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.696 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_xxeD7TssMyWfSY39I2Qdo-t", 2020-10-05T12:10:10.696 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.696 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.697 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.697 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899381.995677_244.1", 2020-10-05T12:10:10.697 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.698 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:10.698 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:01.995677672Z", 2020-10-05T12:10:10.698 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.698 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.698 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:10.698 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.699 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:10.699 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.699 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.699 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.700 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899382.001389_245.1", 2020-10-05T12:10:10.700 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.700 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-19:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.19", 2020-10-05T12:10:10.700 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:02.001389904Z", 2020-10-05T12:10:10.701 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.701 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:10.701 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.701 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t9OTPuOzy1drvXemMal2xsY", 2020-10-05T12:10:10.701 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.702 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.702 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.703 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899541.302756_246.1", 2020-10-05T12:10:10.703 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.703 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:10.703 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:41.302756422Z", 2020-10-05T12:10:10.703 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.703 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.703 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.704 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.704 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.704 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:10.704 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.704 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.705 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.705 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899541.307820_257.1", 2020-10-05T12:10:10.705 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.706 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:10.706 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:41.307820582Z", 2020-10-05T12:10:10.706 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.706 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.706 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.706 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.707 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.707 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:10.707 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.707 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.707 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.708 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899541.310387_258.1", 2020-10-05T12:10:10.708 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.708 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20", 2020-10-05T12:10:10.708 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:41.310387536Z", 2020-10-05T12:10:10.709 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.709 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.709 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.709 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_aImoYIeVSR4CuPJ5tgqZ62Z", 2020-10-05T12:10:10.710 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.710 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.710 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.711 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899541.316365_259.1", 2020-10-05T12:10:10.711 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.711 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20", 2020-10-05T12:10:10.711 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:41.316365619Z", 2020-10-05T12:10:10.711 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.711 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.712 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.712 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_aImoYIeVSR4CuPJ5tgqZ62Z", 2020-10-05T12:10:10.712 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.712 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.713 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.713 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899545.730156_260.1", 2020-10-05T12:10:10.713 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.714 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:10.714 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:45.730156910Z", 2020-10-05T12:10:10.714 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.714 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:10.714 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.715 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.715 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:10.715 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.715 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.715 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.716 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899545.740215_264.1", 2020-10-05T12:10:10.716 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.716 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:10.716 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:05:45.740215247Z", 2020-10-05T12:10:10.716 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.717 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.717 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:10.717 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.717 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.717 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:10.718 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.718 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.718 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.719 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899605.527412_276.1", 2020-10-05T12:10:10.719 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.719 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:10.719 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:06:45.527412662Z", 2020-10-05T12:10:10.719 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.720 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.720 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:10.720 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.720 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.720 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:10.720 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:10.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.721 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.721 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.721 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899605.537934_277.1", 2020-10-05T12:10:10.722 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.722 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-20:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.20", 2020-10-05T12:10:10.722 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:06:45.537934497Z", 2020-10-05T12:10:10.722 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.722 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:10.722 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.723 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_bUunG5vE7-LBb7G4lG54fRp", 2020-10-05T12:10:10.723 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:10.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.723 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.723 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.724 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.724 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.724 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.340791_278.1", 2020-10-05T12:10:10.724 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.724 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:10.725 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.340791891Z", 2020-10-05T12:10:10.725 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.725 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.725 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.725 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.726 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.726 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:10.726 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.726 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.726 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.727 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.727 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.727 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.345737_282.1", 2020-10-05T12:10:10.727 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.727 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:10.728 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.345737029Z", 2020-10-05T12:10:10.728 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.728 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.728 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.728 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:10.729 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.729 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.729 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.729 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.729 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.730 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.348030_283.1", 2020-10-05T12:10:10.730 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.730 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-21", 2020-10-05T12:10:10.730 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.348030701Z", 2020-10-05T12:10:10.730 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.730 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.731 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.731 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.731 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.731 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_WJ0jiCyt20VpMPgS98Z4nqG", 2020-10-05T12:10:10.731 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.732 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.732 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.732 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.352832_284.1", 2020-10-05T12:10:10.732 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.733 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-21", 2020-10-05T12:10:10.733 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.352832690Z", 2020-10-05T12:10:10.733 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.733 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.733 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.733 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.734 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_WJ0jiCyt20VpMPgS98Z4nqG", 2020-10-05T12:10:10.734 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.734 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.734 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.735 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.383105_285.1", 2020-10-05T12:10:10.735 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.735 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:10.735 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.383105561Z", 2020-10-05T12:10:10.736 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.736 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.736 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.736 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.736 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.736 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:10.737 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.737 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.737 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.738 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.388239_286.1", 2020-10-05T12:10:10.738 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.738 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:10.738 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.388239047Z", 2020-10-05T12:10:10.738 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.738 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.739 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.739 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.739 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.739 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:10.739 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.740 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.740 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.740 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.390789_287.1", 2020-10-05T12:10:10.741 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.741 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-22", 2020-10-05T12:10:10.741 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.390789948Z", 2020-10-05T12:10:10.741 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.741 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.741 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.741 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.742 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.742 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_0_1hH9wu8fdrjzn6LfnAjui", 2020-10-05T12:10:10.742 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.742 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.742 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.743 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.399241_288.1", 2020-10-05T12:10:10.743 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.743 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-22", 2020-10-05T12:10:10.743 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.399241994Z", 2020-10-05T12:10:10.744 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.744 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.744 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.744 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_0_1hH9wu8fdrjzn6LfnAjui", 2020-10-05T12:10:10.744 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.745 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.745 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.746 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.452745_289.1", 2020-10-05T12:10:10.746 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.746 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:10.746 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.452745488Z", 2020-10-05T12:10:10.746 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.746 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.746 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.747 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.747 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:10.747 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.747 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.747 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.748 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.456617_290.1", 2020-10-05T12:10:10.748 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.748 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:10.749 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.456617145Z", 2020-10-05T12:10:10.749 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.749 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.749 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.749 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.749 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.750 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:10.750 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.750 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.750 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.751 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.458367_291.1", 2020-10-05T12:10:10.751 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.751 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-23", 2020-10-05T12:10:10.751 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.458367135Z", 2020-10-05T12:10:10.751 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.751 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.752 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.752 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.752 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.752 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U97spIGYsVsG6Wu0_S4U1qa", 2020-10-05T12:10:10.752 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.753 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.753 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.753 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.461785_292.1", 2020-10-05T12:10:10.754 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.754 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-23", 2020-10-05T12:10:10.754 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.461785134Z", 2020-10-05T12:10:10.754 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.754 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.754 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.754 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.755 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U97spIGYsVsG6Wu0_S4U1qa", 2020-10-05T12:10:10.755 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.755 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.755 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.756 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.756 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.756 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.486140_293.1", 2020-10-05T12:10:10.756 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.756 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:10.757 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.486140603Z", 2020-10-05T12:10:10.757 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.757 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:10.757 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.757 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:10.758 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.758 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.758 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.759 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.490948_294.1", 2020-10-05T12:10:10.759 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.759 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-21:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.21", 2020-10-05T12:10:10.759 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.490948615Z", 2020-10-05T12:10:10.759 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.759 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.829 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:10.830 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.830 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.830 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cILCXSZ6-TxEytqB-c86eWL", 2020-10-05T12:10:10.830 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.831 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.831 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.831 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.494647_295.1", 2020-10-05T12:10:10.832 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.832 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:10.832 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.494647353Z", 2020-10-05T12:10:10.832 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.832 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.832 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:10.832 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.833 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.833 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:10.833 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.833 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.833 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.834 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.499864_296.1", 2020-10-05T12:10:10.834 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.834 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-22:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.22", 2020-10-05T12:10:10.835 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.499864471Z", 2020-10-05T12:10:10.835 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.835 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.835 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:10.835 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.835 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.836 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_U2Kr0SV3xdb8qQKiIagdb93", 2020-10-05T12:10:10.836 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.836 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.836 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.837 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.507738_297.1", 2020-10-05T12:10:10.837 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.837 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:10.837 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.507738076Z", 2020-10-05T12:10:10.838 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.838 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:10.838 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.838 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:10.839 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.839 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.839 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.840 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899645.514287_298.1", 2020-10-05T12:10:10.840 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.840 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-23:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.23", 2020-10-05T12:10:10.840 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:25.514287293Z", 2020-10-05T12:10:10.840 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.840 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:10.841 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.841 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qFOi21D1NSOTMhq0fjp5JBh", 2020-10-05T12:10:10.841 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.842 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.842 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.842 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.084952_299.1", 2020-10-05T12:10:10.843 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.843 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:10.843 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.084952678Z", 2020-10-05T12:10:10.843 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.843 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.843 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.843 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.844 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.844 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:10.844 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.844 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.844 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.089798_307.1", 2020-10-05T12:10:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:10.845 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.089798521Z", 2020-10-05T12:10:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.091945_308.1", 2020-10-05T12:10:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24", 2020-10-05T12:10:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.091945247Z", 2020-10-05T12:10:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.848 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.849 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_d3QvlMaZvFDsG6fmQcvxore", 2020-10-05T12:10:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.096693_309.1", 2020-10-05T12:10:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24", 2020-10-05T12:10:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.096693948Z", 2020-10-05T12:10:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.851 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_d3QvlMaZvFDsG6fmQcvxore", 2020-10-05T12:10:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.852 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.853 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.119884_310.1", 2020-10-05T12:10:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.119884574Z", 2020-10-05T12:10:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.854 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.855 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.125073_311.1", 2020-10-05T12:10:10.856 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.125073988Z", 2020-10-05T12:10:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.859 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.127106_312.1", 2020-10-05T12:10:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25", 2020-10-05T12:10:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.127106528Z", 2020-10-05T12:10:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.860 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.861 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.861 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_0GztoLidLt71aeEmYBk2KIv", 2020-10-05T12:10:10.861 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.861 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.862 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.862 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.131736_313.1", 2020-10-05T12:10:10.862 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.863 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25", 2020-10-05T12:10:10.863 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.131736717Z", 2020-10-05T12:10:10.863 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.863 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.863 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.863 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.864 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.864 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_0GztoLidLt71aeEmYBk2KIv", 2020-10-05T12:10:10.864 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.864 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.864 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.865 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.176263_314.1", 2020-10-05T12:10:10.865 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.865 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:10.865 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.176263727Z", 2020-10-05T12:10:10.866 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.866 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.866 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.866 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:10.867 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.867 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.867 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.868 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.180812_315.1", 2020-10-05T12:10:10.868 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.868 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:10.868 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.180812847Z", 2020-10-05T12:10:10.868 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.868 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.868 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.869 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.869 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.869 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:10.869 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.869 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.870 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.870 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.182989_316.1", 2020-10-05T12:10:10.870 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.871 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26", 2020-10-05T12:10:10.871 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.182989968Z", 2020-10-05T12:10:10.871 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.871 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.871 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.871 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.872 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t91eQVT6DZi4rGBjwoymGxg", 2020-10-05T12:10:10.872 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.872 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.872 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.872 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.872 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.873 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.186900_317.1", 2020-10-05T12:10:10.873 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.873 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26", 2020-10-05T12:10:10.873 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.186900962Z", 2020-10-05T12:10:10.873 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.874 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.874 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.874 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.874 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.874 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t91eQVT6DZi4rGBjwoymGxg", 2020-10-05T12:10:10.875 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.875 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.875 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.876 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.207415_318.1", 2020-10-05T12:10:10.876 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.876 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:10.876 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.207415448Z", 2020-10-05T12:10:10.876 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.876 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:10.877 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.877 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:10.877 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.877 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.878 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.878 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.212772_319.1", 2020-10-05T12:10:10.878 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.879 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:10.879 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.212772752Z", 2020-10-05T12:10:10.879 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.879 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.879 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:10.879 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.880 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.880 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:10.880 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.880 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.880 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.881 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.216174_320.1", 2020-10-05T12:10:10.881 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.881 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:10.881 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.216174966Z", 2020-10-05T12:10:10.882 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.882 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:10.882 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.882 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:10.883 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:10.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.883 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.883 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.884 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.222896_321.1", 2020-10-05T12:10:10.884 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.884 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-24:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.24", 2020-10-05T12:10:10.884 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.222896035Z", 2020-10-05T12:10:10.884 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.884 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.884 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:10.885 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.885 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_MtocEQO1YrHlgFoF98RIGab", 2020-10-05T12:10:10.885 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:10.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.885 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.886 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.886 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.228952_322.1", 2020-10-05T12:10:10.886 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.887 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:10.887 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.228952822Z", 2020-10-05T12:10:10.887 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.887 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:10.887 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.887 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.888 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:10.888 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.888 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.888 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.889 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.241169_323.1", 2020-10-05T12:10:10.889 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.889 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:10.889 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.241169846Z", 2020-10-05T12:10:10.889 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.890 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:10.890 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.890 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:10.891 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.891 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.891 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.892 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.267420_324.1", 2020-10-05T12:10:10.892 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.892 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:10.892 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.267420223Z", 2020-10-05T12:10:10.892 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.892 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.892 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:10.893 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.893 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.893 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:10.893 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:10.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.893 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.894 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.894 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.272326_325.1", 2020-10-05T12:10:10.894 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.895 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-25:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.25", 2020-10-05T12:10:10.895 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.272326174Z", 2020-10-05T12:10:10.895 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.895 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:10.895 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.895 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.896 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_n9Hdnfnn0Ce9nJJtBWXRtR7", 2020-10-05T12:10:10.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:10.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.896 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.896 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.897 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.281362_326.1", 2020-10-05T12:10:10.897 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.897 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:10.897 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.281362477Z", 2020-10-05T12:10:10.897 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.897 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:10.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.898 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:10.898 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.899 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.899 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.899 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.298750_327.1", 2020-10-05T12:10:10.900 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.900 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:10.900 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.298750857Z", 2020-10-05T12:10:10.900 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.900 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:10.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.901 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.901 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:10.901 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.901 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.901 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.902 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.311388_328.1", 2020-10-05T12:10:10.902 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.902 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:10.903 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.311388336Z", 2020-10-05T12:10:10.903 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.903 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:10.903 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.903 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.904 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:10.904 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:10.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.904 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.904 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.905 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899656.318021_329.1", 2020-10-05T12:10:10.905 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.905 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-26:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.26", 2020-10-05T12:10:10.905 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:36.318021017Z", 2020-10-05T12:10:10.905 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.905 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.906 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:10.906 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.906 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.906 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EbVgr5PHvS7kNlOGpy5ilSl", 2020-10-05T12:10:10.906 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 3 2020-10-05T12:10:10.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.907 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.907 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.907 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.685537_330.1", 2020-10-05T12:10:10.908 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.908 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:10.908 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.685537275Z", 2020-10-05T12:10:10.908 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.908 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.908 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.909 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.909 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:10.909 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.909 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.909 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.910 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.689965_338.1", 2020-10-05T12:10:10.910 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.910 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:10.910 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.689965260Z", 2020-10-05T12:10:10.911 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.911 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.911 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.911 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.911 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.911 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:10.912 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.912 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.912 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.913 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.691704_339.1", 2020-10-05T12:10:10.913 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.913 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-27", 2020-10-05T12:10:10.913 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.691704538Z", 2020-10-05T12:10:10.913 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.913 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.914 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.914 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.914 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.914 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_3ghfMalV8FJvx__fjUkOrTe", 2020-10-05T12:10:10.914 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.696863_340.1", 2020-10-05T12:10:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-27", 2020-10-05T12:10:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.696863318Z", 2020-10-05T12:10:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_3ghfMalV8FJvx__fjUkOrTe", 2020-10-05T12:10:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.917 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.724232_341.1", 2020-10-05T12:10:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.918 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.724232023Z", 2020-10-05T12:10:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.919 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.729087_342.1", 2020-10-05T12:10:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.729087316Z", 2020-10-05T12:10:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.921 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.731113_343.1", 2020-10-05T12:10:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-28", 2020-10-05T12:10:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.731113851Z", 2020-10-05T12:10:10.924 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.925 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qZhqLSO2IT-th3DUT4YqnJL", 2020-10-05T12:10:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.927 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.735226_344.1", 2020-10-05T12:10:10.927 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.927 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-28", 2020-10-05T12:10:10.927 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.735226387Z", 2020-10-05T12:10:10.927 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.928 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.928 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.928 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.928 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.928 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qZhqLSO2IT-th3DUT4YqnJL", 2020-10-05T12:10:10.928 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.929 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.929 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.930 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.784620_345.1", 2020-10-05T12:10:10.930 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.930 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:10.930 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.784620187Z", 2020-10-05T12:10:10.931 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.931 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.931 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.931 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.931 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.931 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:10.932 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.932 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.932 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.933 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.790107_346.1", 2020-10-05T12:10:10.933 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.933 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:10.933 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.790107967Z", 2020-10-05T12:10:10.933 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.933 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.933 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.934 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.934 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.934 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:10.934 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.934 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.935 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.935 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.792020_347.1", 2020-10-05T12:10:10.935 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.935 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-29", 2020-10-05T12:10:10.936 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.792020540Z", 2020-10-05T12:10:10.936 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.936 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.936 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.936 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.936 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.937 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qBLhF76LBUvDFkuAku_lLJs", 2020-10-05T12:10:10.937 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.937 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.937 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.938 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.796655_348.1", 2020-10-05T12:10:10.938 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.938 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-29", 2020-10-05T12:10:10.938 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.796655308Z", 2020-10-05T12:10:10.938 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_qBLhF76LBUvDFkuAku_lLJs", 2020-10-05T12:10:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.839365_349.1", 2020-10-05T12:10:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.839365259Z", 2020-10-05T12:10:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.942 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.942 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:10.942 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.942 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.942 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.943 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.845048_350.1", 2020-10-05T12:10:10.943 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.943 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-27:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.27", 2020-10-05T12:10:10.944 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.845048144Z", 2020-10-05T12:10:10.944 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.944 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:10.944 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.944 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gIsalBKT1b7oYCvefaEFJIF", 2020-10-05T12:10:10.945 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.945 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.945 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.945 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.945 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.946 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.892935_351.1", 2020-10-05T12:10:10.946 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.946 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:10.946 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.892935368Z", 2020-10-05T12:10:10.946 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.946 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:10.947 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.947 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:10.947 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.948 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.948 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.948 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.901826_352.1", 2020-10-05T12:10:10.949 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.949 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-28:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.28", 2020-10-05T12:10:10.949 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.901826223Z", 2020-10-05T12:10:10.949 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.949 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:10.949 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_CDdLnHzWsEVPcksiTk-_B0L", 2020-10-05T12:10:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.959774_353.1", 2020-10-05T12:10:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.959774780Z", 2020-10-05T12:10:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899665.970218_354.1", 2020-10-05T12:10:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-29:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.29", 2020-10-05T12:10:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:45.970218043Z", 2020-10-05T12:10:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UdxH6fDkXZHKdc0zFOCnG_G", 2020-10-05T12:10:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.042360_355.1", 2020-10-05T12:10:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.042360998Z", 2020-10-05T12:10:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.048194_356.1", 2020-10-05T12:10:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.048194819Z", 2020-10-05T12:10:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.053339_357.1", 2020-10-05T12:10:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-30", 2020-10-05T12:10:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.053339803Z", 2020-10-05T12:10:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_7U7eHcX5CMNoEpAGs_GrGNM", 2020-10-05T12:10:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.061637_358.1", 2020-10-05T12:10:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-30", 2020-10-05T12:10:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.061637328Z", 2020-10-05T12:10:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_7U7eHcX5CMNoEpAGs_GrGNM", 2020-10-05T12:10:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.082626_359.1", 2020-10-05T12:10:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.082626326Z", 2020-10-05T12:10:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.088179_360.1", 2020-10-05T12:10:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.088179217Z", 2020-10-05T12:10:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.972 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.093155_361.1", 2020-10-05T12:10:10.972 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.972 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-31", 2020-10-05T12:10:10.972 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.093155536Z", 2020-10-05T12:10:10.972 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.973 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.973 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.973 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.973 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.973 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_dG5Cl_WMxrVmCxRlv_ggf_X", 2020-10-05T12:10:10.973 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.974 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.974 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.974 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.100733_362.1", 2020-10-05T12:10:10.975 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.975 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-31", 2020-10-05T12:10:10.975 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.100733753Z", 2020-10-05T12:10:10.975 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.975 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.975 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.976 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.976 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_dG5Cl_WMxrVmCxRlv_ggf_X", 2020-10-05T12:10:10.976 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.976 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.976 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.977 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.142756_363.1", 2020-10-05T12:10:10.977 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.977 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:10.977 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.142756231Z", 2020-10-05T12:10:10.978 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.978 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.978 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.978 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.978 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.978 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:10.979 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.979 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.979 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.980 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.147332_364.1", 2020-10-05T12:10:10.980 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.980 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:10.980 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.147332504Z", 2020-10-05T12:10:10.980 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.980 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.980 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.981 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.981 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.981 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:10.981 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.981 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.981 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.982 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.149290_365.1", 2020-10-05T12:10:10.982 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.982 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-32", 2020-10-05T12:10:10.983 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.149290141Z", 2020-10-05T12:10:10.983 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.983 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.983 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.983 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.983 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.984 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_szbUgjaae7_m6uBd5TkL2Ow", 2020-10-05T12:10:10.984 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.984 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.984 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.985 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.153116_366.1", 2020-10-05T12:10:10.985 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:10.985 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-32", 2020-10-05T12:10:10.985 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.153116214Z", 2020-10-05T12:10:10.985 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.985 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.986 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:10.986 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:10.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.986 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.986 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_szbUgjaae7_m6uBd5TkL2Ow", 2020-10-05T12:10:10.986 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.987 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.987 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.987 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.177454_367.1", 2020-10-05T12:10:10.988 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.988 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:10.988 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.177454223Z", 2020-10-05T12:10:10.988 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.988 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.988 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:10.988 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.989 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.989 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:10.989 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.989 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.989 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.989 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.990 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.184234_368.1", 2020-10-05T12:10:10.990 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.990 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-30:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.30", 2020-10-05T12:10:10.990 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.184234806Z", 2020-10-05T12:10:10.991 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.991 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.991 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:10.991 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.991 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.991 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_UbIqF-WEvAiqIHao2giivG2", 2020-10-05T12:10:10.991 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.992 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.992 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.993 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.239181_369.1", 2020-10-05T12:10:10.993 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.993 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:10.993 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.239181274Z", 2020-10-05T12:10:10.993 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.993 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.993 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:10.994 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.994 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.994 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:10.994 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.994 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.250627_370.1", 2020-10-05T12:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-31:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.31", 2020-10-05T12:10:10.996 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.250627601Z", 2020-10-05T12:10:10.996 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.996 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.996 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:10.996 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.996 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.997 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "__XOqfrlPUjuaqUKU837b1um", 2020-10-05T12:10:10.997 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:10.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.997 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:10.997 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:10.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:10.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:10.998 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.330136_371.1", 2020-10-05T12:10:10.998 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:10.998 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:10.999 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.330136508Z", 2020-10-05T12:10:10.999 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:10.999 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:10.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:10.999 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:10.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:10.999 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:10.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:11.000 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:11.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.000 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.000 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.001 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.344671_372.1", 2020-10-05T12:10:11.001 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.001 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-32:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.32", 2020-10-05T12:10:11.001 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.344671408Z", 2020-10-05T12:10:11.001 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.001 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.001 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:11.002 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.002 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.002 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_en-b-WRIvZmdhtmKQe-kAJw", 2020-10-05T12:10:11.002 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:11.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.003 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.003 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.003 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.003 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.003 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.409725_373.1", 2020-10-05T12:10:11.004 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.004 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:11.004 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.409725716Z", 2020-10-05T12:10:11.004 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.004 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.004 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.004 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.005 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.005 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:11.005 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.005 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.005 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.006 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.006 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.414399_374.1", 2020-10-05T12:10:11.006 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.006 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:11.006 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.414399267Z", 2020-10-05T12:10:11.007 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.007 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.007 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.007 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.007 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.007 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:11.008 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.008 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.008 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.008 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.008 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.009 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.416593_375.1", 2020-10-05T12:10:11.009 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.009 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-33", 2020-10-05T12:10:11.009 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.416593573Z", 2020-10-05T12:10:11.009 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.009 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EyrR1NPa80nMYyy_aATR-lo", 2020-10-05T12:10:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.011 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.422118_376.1", 2020-10-05T12:10:11.012 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.012 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-33", 2020-10-05T12:10:11.012 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.422118088Z", 2020-10-05T12:10:11.012 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.012 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.012 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.012 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.013 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.013 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EyrR1NPa80nMYyy_aATR-lo", 2020-10-05T12:10:11.013 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.013 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.013 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.014 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.457009_377.1", 2020-10-05T12:10:11.014 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.014 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:11.015 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.457009356Z", 2020-10-05T12:10:11.015 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.015 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.015 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.015 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.015 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.015 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:11.016 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.016 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.016 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.017 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.460962_378.1", 2020-10-05T12:10:11.017 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.017 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:11.017 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.460962760Z", 2020-10-05T12:10:11.017 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.017 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.017 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.018 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.018 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.018 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:11.018 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.018 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.019 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.019 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.462754_379.1", 2020-10-05T12:10:11.019 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.020 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-34", 2020-10-05T12:10:11.020 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.462754733Z", 2020-10-05T12:10:11.020 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.020 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.020 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.020 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.020 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.021 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_aVIFxV-3ngBmVcQFfKjSUBE", 2020-10-05T12:10:11.021 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.021 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.021 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.022 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.466366_380.1", 2020-10-05T12:10:11.022 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.022 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-34", 2020-10-05T12:10:11.022 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.466366720Z", 2020-10-05T12:10:11.022 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.023 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.023 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.023 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.023 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.023 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_aVIFxV-3ngBmVcQFfKjSUBE", 2020-10-05T12:10:11.023 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.024 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.024 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.025 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.499953_381.1", 2020-10-05T12:10:11.025 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.025 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:11.025 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.499953363Z", 2020-10-05T12:10:11.025 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.025 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.025 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.025 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.026 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.026 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:11.026 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.026 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.026 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.027 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.504875_382.1", 2020-10-05T12:10:11.027 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.027 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:11.028 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.504875519Z", 2020-10-05T12:10:11.028 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.028 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.028 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.028 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.028 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.028 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:11.029 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.029 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.029 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.030 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.507574_383.1", 2020-10-05T12:10:11.030 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.030 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-35", 2020-10-05T12:10:11.030 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.507574492Z", 2020-10-05T12:10:11.030 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.030 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.031 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.031 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.031 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.031 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_--X6GvPo7a_vb5l6gavGQUo", 2020-10-05T12:10:11.031 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.031 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.032 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.032 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.512697_384.1", 2020-10-05T12:10:11.032 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.033 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-35", 2020-10-05T12:10:11.033 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.512697176Z", 2020-10-05T12:10:11.033 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.033 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.033 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.033 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.033 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.034 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_--X6GvPo7a_vb5l6gavGQUo", 2020-10-05T12:10:11.034 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.034 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.034 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.035 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.538401_385.1", 2020-10-05T12:10:11.035 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.035 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:11.036 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.538401203Z", 2020-10-05T12:10:11.036 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.036 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.036 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:11.036 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.037 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.037 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:11.037 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:11.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.037 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.037 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899666.544174_386.1", 2020-10-05T12:10:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-33:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.33", 2020-10-05T12:10:11.038 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:46.544174292Z", 2020-10-05T12:10:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Q1q-YCLtd0-gz4E702yfatG", 2020-10-05T12:10:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899667.597394_387.1", 2020-10-05T12:10:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:11.041 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:47.597394776Z", 2020-10-05T12:10:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899667.608381_388.1", 2020-10-05T12:10:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-34:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.34", 2020-10-05T12:10:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:47.608381219Z", 2020-10-05T12:10:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.044 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_sC64WQi3ydks4b-j48FmQ95", 2020-10-05T12:10:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.046 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.669772_389.1", 2020-10-05T12:10:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.669772427Z", 2020-10-05T12:10:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:11.047 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.681403_390.1", 2020-10-05T12:10:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-35:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.35", 2020-10-05T12:10:11.049 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.681403105Z", 2020-10-05T12:10:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.050 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.051 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_FulBHZk8K94q0v9kkAIlWe5", 2020-10-05T12:10:11.051 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:11.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.051 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.051 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.755317_391.1", 2020-10-05T12:10:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-36:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.36", 2020-10-05T12:10:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.755317269Z", 2020-10-05T12:10:11.052 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_3icl_ECM1V9msMyvu87yxtG", 2020-10-05T12:10:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.760371_392.1", 2020-10-05T12:10:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-36:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.36", 2020-10-05T12:10:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.760371672Z", 2020-10-05T12:10:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.055 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_3icl_ECM1V9msMyvu87yxtG", 2020-10-05T12:10:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.762899_393.1", 2020-10-05T12:10:11.057 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-36", 2020-10-05T12:10:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.762899080Z", 2020-10-05T12:10:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_8WZRY6hDRE8a9myMhYrKAX_", 2020-10-05T12:10:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.767561_394.1", 2020-10-05T12:10:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-36", 2020-10-05T12:10:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.767561731Z", 2020-10-05T12:10:11.060 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_8WZRY6hDRE8a9myMhYrKAX_", 2020-10-05T12:10:11.061 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.797969_395.1", 2020-10-05T12:10:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-37:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.37", 2020-10-05T12:10:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.797969247Z", 2020-10-05T12:10:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.063 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rp3Sewj1i--RN9QFC9kTl1R", 2020-10-05T12:10:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.802805_396.1", 2020-10-05T12:10:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-37:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.37", 2020-10-05T12:10:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.802805288Z", 2020-10-05T12:10:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rp3Sewj1i--RN9QFC9kTl1R", 2020-10-05T12:10:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.804808_397.1", 2020-10-05T12:10:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-37", 2020-10-05T12:10:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.804808204Z", 2020-10-05T12:10:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_m6h3qoVJUfeAaOYxYpjLCny", 2020-10-05T12:10:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.808515_398.1", 2020-10-05T12:10:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-37", 2020-10-05T12:10:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.808515097Z", 2020-10-05T12:10:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_m6h3qoVJUfeAaOYxYpjLCny", 2020-10-05T12:10:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.872453_399.1", 2020-10-05T12:10:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-38:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.38", 2020-10-05T12:10:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.872453804Z", 2020-10-05T12:10:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_-HoKnRhe8TocC-rxrrEt-K9", 2020-10-05T12:10:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.876761_400.1", 2020-10-05T12:10:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-38:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.38", 2020-10-05T12:10:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.876761083Z", 2020-10-05T12:10:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_-HoKnRhe8TocC-rxrrEt-K9", 2020-10-05T12:10:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.879002_401.1", 2020-10-05T12:10:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-38", 2020-10-05T12:10:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.879002719Z", 2020-10-05T12:10:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_s0iZkzLPbkOXiRUVThv-a9T", 2020-10-05T12:10:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899668.888419_402.1", 2020-10-05T12:10:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-38", 2020-10-05T12:10:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:48.888419542Z", 2020-10-05T12:10:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_s0iZkzLPbkOXiRUVThv-a9T", 2020-10-05T12:10:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.482263_403.1", 2020-10-05T12:10:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-39:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.39", 2020-10-05T12:10:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.482263867Z", 2020-10-05T12:10:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.084 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_mBr7LUv6iNJJo-p_fWMP8K5", 2020-10-05T12:10:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.486347_405.1", 2020-10-05T12:10:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-39:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.39", 2020-10-05T12:10:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.486347434Z", 2020-10-05T12:10:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.087 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_mBr7LUv6iNJJo-p_fWMP8K5", 2020-10-05T12:10:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.088 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.488367_406.1", 2020-10-05T12:10:11.089 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-39", 2020-10-05T12:10:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.488367312Z", 2020-10-05T12:10:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.090 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_xFlhJ327xLR_penGucomc8D", 2020-10-05T12:10:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.492419_407.1", 2020-10-05T12:10:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-39", 2020-10-05T12:10:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.492419420Z", 2020-10-05T12:10:11.092 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_xFlhJ327xLR_penGucomc8D", 2020-10-05T12:10:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.094 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.523672_408.1", 2020-10-05T12:10:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-40:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.40", 2020-10-05T12:10:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.523672589Z", 2020-10-05T12:10:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.095 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_M4WWBNi5IJ-RWpNAHhcS0lG", 2020-10-05T12:10:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.096 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.528666_409.1", 2020-10-05T12:10:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-40:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.40", 2020-10-05T12:10:11.097 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.528666589Z", 2020-10-05T12:10:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.098 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_M4WWBNi5IJ-RWpNAHhcS0lG", 2020-10-05T12:10:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.533845_410.1", 2020-10-05T12:10:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-40", 2020-10-05T12:10:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.533845466Z", 2020-10-05T12:10:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.100 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gWvQIgj3cIEvwYjW0hD1OuM", 2020-10-05T12:10:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.101 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.541752_411.1", 2020-10-05T12:10:11.102 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-40", 2020-10-05T12:10:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.541752331Z", 2020-10-05T12:10:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.103 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_gWvQIgj3cIEvwYjW0hD1OuM", 2020-10-05T12:10:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.597447_412.1", 2020-10-05T12:10:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-41:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.41", 2020-10-05T12:10:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.597447087Z", 2020-10-05T12:10:11.105 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_eaDHMmwfm1xaPKhMWupCPOl", 2020-10-05T12:10:11.106 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.602294_413.1", 2020-10-05T12:10:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-41:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.41", 2020-10-05T12:10:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.602294636Z", 2020-10-05T12:10:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.108 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_eaDHMmwfm1xaPKhMWupCPOl", 2020-10-05T12:10:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.109 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.604098_414.1", 2020-10-05T12:10:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.110 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-41", 2020-10-05T12:10:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.604098679Z", 2020-10-05T12:10:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.111 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Qk4kFwtlsplX3FbEXjLvzNg", 2020-10-05T12:10:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899670.607428_415.1", 2020-10-05T12:10:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-41", 2020-10-05T12:10:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.607428984Z", 2020-10-05T12:10:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.113 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.114 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Qk4kFwtlsplX3FbEXjLvzNg", 2020-10-05T12:10:11.115 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.309220_45.1", 2020-10-05T12:10:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-1:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.1", 2020-10-05T12:10:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.309220986Z", 2020-10-05T12:10:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.117 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_yW5321q_H3rgrXH_8hp_2oS", 2020-10-05T12:10:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.118 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.323188_52.1", 2020-10-05T12:10:11.119 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-1:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.1", 2020-10-05T12:10:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.323188619Z", 2020-10-05T12:10:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_yW5321q_H3rgrXH_8hp_2oS", 2020-10-05T12:10:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.324606_53.1", 2020-10-05T12:10:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-1", 2020-10-05T12:10:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.324606525Z", 2020-10-05T12:10:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_O5mZZC9qWHtFDZP9jX8TRT7", 2020-10-05T12:10:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.330398_54.1", 2020-10-05T12:10:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-1", 2020-10-05T12:10:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.330398615Z", 2020-10-05T12:10:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_O5mZZC9qWHtFDZP9jX8TRT7", 2020-10-05T12:10:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.352875_55.1", 2020-10-05T12:10:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-2:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.2", 2020-10-05T12:10:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.352875916Z", 2020-10-05T12:10:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_jFiFlBW0gJEjys5t9-_iV1V", 2020-10-05T12:10:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.359690_56.1", 2020-10-05T12:10:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-2:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.2", 2020-10-05T12:10:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.359690270Z", 2020-10-05T12:10:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_jFiFlBW0gJEjys5t9-_iV1V", 2020-10-05T12:10:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.362078_57.1", 2020-10-05T12:10:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-2", 2020-10-05T12:10:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.362078463Z", 2020-10-05T12:10:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_WwokRaHlmdENZ_Gh_tirmfG", 2020-10-05T12:10:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899133.372604_58.1", 2020-10-05T12:10:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-2", 2020-10-05T12:10:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:53.372604328Z", 2020-10-05T12:10:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_WwokRaHlmdENZ_Gh_tirmfG", 2020-10-05T12:10:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899136.699771_60.1", 2020-10-05T12:10:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-3:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.3", 2020-10-05T12:10:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:56.699771738Z", 2020-10-05T12:10:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rmwjFru8PLxDCA-VIsNWDx7", 2020-10-05T12:10:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899136.704901_61.1", 2020-10-05T12:10:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-3:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.3", 2020-10-05T12:10:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:56.704901138Z", 2020-10-05T12:10:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rmwjFru8PLxDCA-VIsNWDx7", 2020-10-05T12:10:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899136.707633_62.1", 2020-10-05T12:10:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-3", 2020-10-05T12:10:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:56.707633249Z", 2020-10-05T12:10:11.143 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Ae2fl6vm7rY1i6OtshHDi2X", 2020-10-05T12:10:11.144 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.145 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899136.712011_63.1", 2020-10-05T12:10:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-3", 2020-10-05T12:10:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:56.712011683Z", 2020-10-05T12:10:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.146 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Ae2fl6vm7rY1i6OtshHDi2X", 2020-10-05T12:10:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.147 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899137.978801_67.1", 2020-10-05T12:10:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-4:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.4", 2020-10-05T12:10:11.148 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:57.978801960Z", 2020-10-05T12:10:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.149 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_R9cr1AM7-ROLCvUODxti2Hy", 2020-10-05T12:10:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899137.983575_68.1", 2020-10-05T12:10:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-4:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.4", 2020-10-05T12:10:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:57.983575708Z", 2020-10-05T12:10:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.151 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_R9cr1AM7-ROLCvUODxti2Hy", 2020-10-05T12:10:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.152 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.153 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.153 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899137.985378_69.1", 2020-10-05T12:10:11.153 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.153 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-4", 2020-10-05T12:10:11.154 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:57.985378089Z", 2020-10-05T12:10:11.154 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.154 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.154 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.154 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.154 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.155 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_L7bOK0Z4V74uuwLURFH192I", 2020-10-05T12:10:11.155 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.155 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.155 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.156 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899137.989603_70.1", 2020-10-05T12:10:11.156 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.156 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-4", 2020-10-05T12:10:11.156 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:57.989603894Z", 2020-10-05T12:10:11.156 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.156 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.157 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.157 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.157 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.157 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_L7bOK0Z4V74uuwLURFH192I", 2020-10-05T12:10:11.157 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.158 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.158 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.158 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.008931_71.1", 2020-10-05T12:10:11.158 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.159 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-5:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.5", 2020-10-05T12:10:11.159 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.008931512Z", 2020-10-05T12:10:11.159 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.159 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.159 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.159 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.160 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.160 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_mFQkTXg1VqZK7t8XsW9miUA", 2020-10-05T12:10:11.160 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.160 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.160 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.160 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.161 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.013300_72.1", 2020-10-05T12:10:11.161 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.161 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-5:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.5", 2020-10-05T12:10:11.161 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.013300296Z", 2020-10-05T12:10:11.161 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.162 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.162 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.162 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.162 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.162 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_mFQkTXg1VqZK7t8XsW9miUA", 2020-10-05T12:10:11.163 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.163 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.163 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.164 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.015249_73.1", 2020-10-05T12:10:11.164 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.164 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-5", 2020-10-05T12:10:11.164 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.015249875Z", 2020-10-05T12:10:11.164 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.164 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.164 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.165 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.165 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.165 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_SdAKsFkJizj_YE8B3JhFv3K", 2020-10-05T12:10:11.165 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.165 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.166 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.166 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.019329_74.1", 2020-10-05T12:10:11.166 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-5", 2020-10-05T12:10:11.239 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.019329476Z", 2020-10-05T12:10:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.240 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_SdAKsFkJizj_YE8B3JhFv3K", 2020-10-05T12:10:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.062991_75.1", 2020-10-05T12:10:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.242 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-6:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.6", 2020-10-05T12:10:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.062991051Z", 2020-10-05T12:10:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.243 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_h3WoSQnsgDcU-Zg3rO1vbjh", 2020-10-05T12:10:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.067217_76.1", 2020-10-05T12:10:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-6:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.6", 2020-10-05T12:10:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.067217484Z", 2020-10-05T12:10:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.245 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_h3WoSQnsgDcU-Zg3rO1vbjh", 2020-10-05T12:10:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.069962_77.1", 2020-10-05T12:10:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-6", 2020-10-05T12:10:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.069962715Z", 2020-10-05T12:10:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_au9QcNPZmxYIo3XlQDwiive", 2020-10-05T12:10:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.249 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.250 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899138.076875_78.1", 2020-10-05T12:10:11.250 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.250 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-6", 2020-10-05T12:10:11.251 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:58:58.076875124Z", 2020-10-05T12:10:11.251 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.251 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.251 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.251 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.252 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.252 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_au9QcNPZmxYIo3XlQDwiive", 2020-10-05T12:10:11.252 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.252 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.253 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.253 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.926594_79.1", 2020-10-05T12:10:11.254 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.254 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-7:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.7", 2020-10-05T12:10:11.254 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.926594218Z", 2020-10-05T12:10:11.254 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.254 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.254 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.255 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.255 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.255 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cPLQuBKjrWMkd6tqHbbfy0H", 2020-10-05T12:10:11.255 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.255 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.255 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.256 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.931290_84.1", 2020-10-05T12:10:11.256 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.256 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-7:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.7", 2020-10-05T12:10:11.257 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.931290785Z", 2020-10-05T12:10:11.257 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.257 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.257 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.257 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.258 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.258 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_cPLQuBKjrWMkd6tqHbbfy0H", 2020-10-05T12:10:11.258 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.258 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.258 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.259 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.933342_85.1", 2020-10-05T12:10:11.259 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.260 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-7", 2020-10-05T12:10:11.260 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.933342285Z", 2020-10-05T12:10:11.260 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.260 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.260 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.260 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.261 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.261 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:11.261 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.261 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.261 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.262 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.939592_86.1", 2020-10-05T12:10:11.262 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.262 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-7", 2020-10-05T12:10:11.263 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.939592960Z", 2020-10-05T12:10:11.263 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.263 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.263 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.263 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.264 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:11.264 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.264 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.264 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.265 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.961360_87.1", 2020-10-05T12:10:11.265 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.266 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-8:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.8", 2020-10-05T12:10:11.266 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.961360327Z", 2020-10-05T12:10:11.266 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.266 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.266 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.267 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.267 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.267 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_VfDg-vSGbYSY-RkVKPKcS4N", 2020-10-05T12:10:11.267 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.267 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.267 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.268 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.966517_88.1", 2020-10-05T12:10:11.268 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.269 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-8:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.8", 2020-10-05T12:10:11.269 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.966517542Z", 2020-10-05T12:10:11.269 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.269 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.269 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.269 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.269 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.270 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_VfDg-vSGbYSY-RkVKPKcS4N", 2020-10-05T12:10:11.270 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.270 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.270 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.271 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.970413_89.1", 2020-10-05T12:10:11.271 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.271 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-8", 2020-10-05T12:10:11.271 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.970413680Z", 2020-10-05T12:10:11.271 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.272 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.272 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.272 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.272 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.272 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:11.272 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.273 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.273 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.273 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.273 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.273 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899140.978679_90.1", 2020-10-05T12:10:11.274 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.274 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-8", 2020-10-05T12:10:11.274 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:00.978679498Z", 2020-10-05T12:10:11.274 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.274 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.274 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.274 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.275 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.275 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:11.275 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.275 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.275 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.276 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899141.016163_91.1", 2020-10-05T12:10:11.277 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.277 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-9:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.9", 2020-10-05T12:10:11.277 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:01.016163231Z", 2020-10-05T12:10:11.277 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.277 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.277 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.277 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.278 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.278 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Du3Kn9J3DjlCQqjeBWYnZfm", 2020-10-05T12:10:11.278 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.278 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.278 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.279 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899141.026253_92.1", 2020-10-05T12:10:11.279 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.279 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-9:35a06950-5b24-42ca-86ff-3dc913eb1ccc.4340.9", 2020-10-05T12:10:11.280 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:01.026253368Z", 2020-10-05T12:10:11.280 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.280 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.280 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.280 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.280 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.281 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Du3Kn9J3DjlCQqjeBWYnZfm", 2020-10-05T12:10:11.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.281 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.281 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.282 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899141.029629_93.1", 2020-10-05T12:10:11.282 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.283 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-9", 2020-10-05T12:10:11.283 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:01.029629977Z", 2020-10-05T12:10:11.283 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.283 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.283 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.284 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.284 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:11.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.284 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.284 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.285 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899141.037160_94.1", 2020-10-05T12:10:11.285 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.285 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-9", 2020-10-05T12:10:11.286 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:01.037160652Z", 2020-10-05T12:10:11.286 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.286 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.286 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.286 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.287 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:11.287 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.287 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.287 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.288 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899142.364959_95.1", 2020-10-05T12:10:11.288 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.288 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-7", 2020-10-05T12:10:11.288 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.364959162Z", 2020-10-05T12:10:11.288 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.288 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.289 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:11.289 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.289 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.289 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:11.289 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:11.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.290 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.290 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "remove" 2020-10-05T12:10:11.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.291 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899142.371195_98.1", 2020-10-05T12:10:11.291 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.291 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-7", 2020-10-05T12:10:11.291 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.371195860Z", 2020-10-05T12:10:11.291 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.291 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.292 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:11.292 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.292 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.292 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AISOrwr2pcgNDAc3uAS9nSQ", 2020-10-05T12:10:11.292 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:11.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.293 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.293 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.293 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899142.428255_99.1", 2020-10-05T12:10:11.294 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.294 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-8", 2020-10-05T12:10:11.294 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.428255930Z", 2020-10-05T12:10:11.294 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.294 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.294 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:11.294 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.295 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.295 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:11.295 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:11.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.295 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.295 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "remove" 2020-10-05T12:10:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899142.434846_100.1", 2020-10-05T12:10:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-8", 2020-10-05T12:10:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.434846076Z", 2020-10-05T12:10:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_rKVVcIp47pwmrI-y6VyduqS", 2020-10-05T12:10:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899142.528196_101.1", 2020-10-05T12:10:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-9", 2020-10-05T12:10:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.528196199Z", 2020-10-05T12:10:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "remove" 2020-10-05T12:10:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899142.535244_102.1", 2020-10-05T12:10:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-9", 2020-10-05T12:10:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244574Z", 2020-10-05T12:10:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_nvSvBtUpHIVkG0ZZY2Grx08", 2020-10-05T12:10:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 2 2020-10-05T12:10:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.304 INFO:teuthology.orchestra.run.smithi081.stdout:] 2020-10-05T12:10:11.308 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:11.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:11.309 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period de1ec5d2-2844-47c8-bc1d-b6fc2f043687 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:11.346 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:11.347 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:11.562 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:10:11.563 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:11.563 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.515010_55.1", 2020-10-05T12:10:11.563 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.563 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-42:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.1", 2020-10-05T12:10:11.563 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.515010710Z", 2020-10-05T12:10:11.563 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:11.564 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:11.564 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:11.564 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:11.564 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.564 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:11.564 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pwyyshAuQicrUlLN4I3O3nj", 2020-10-05T12:10:11.564 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:11.565 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.565 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:11.565 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:11.565 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.565 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.565 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.565 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:11.566 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.521580_56.1", 2020-10-05T12:10:11.566 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.566 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-42:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.1", 2020-10-05T12:10:11.566 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.521580823Z", 2020-10-05T12:10:11.566 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:11.566 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:11.566 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:11.567 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:11.567 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.567 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:11.567 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pwyyshAuQicrUlLN4I3O3nj", 2020-10-05T12:10:11.567 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:11.567 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.567 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:11.568 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:11.568 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.568 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.568 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.568 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:11.568 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.523478_57.1", 2020-10-05T12:10:11.568 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:11.569 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-42", 2020-10-05T12:10:11.569 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.523478837Z", 2020-10-05T12:10:11.569 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:11.569 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:11.569 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:11.569 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:11.569 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.570 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:11.570 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_T-W7uOlao6VmfbAEfQE0jWL", 2020-10-05T12:10:11.570 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:11.570 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.570 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:11.570 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:11.570 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.571 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.571 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.571 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:11.571 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.528547_58.1", 2020-10-05T12:10:11.571 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:11.571 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-42", 2020-10-05T12:10:11.572 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.528547324Z", 2020-10-05T12:10:11.572 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:11.572 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:11.572 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:11.572 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:11.572 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.573 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:11.573 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_T-W7uOlao6VmfbAEfQE0jWL", 2020-10-05T12:10:11.573 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:11.573 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.573 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:11.573 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:11.573 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.574 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.574 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.574 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:11.574 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.591978_59.1", 2020-10-05T12:10:11.574 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.575 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-43:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.2", 2020-10-05T12:10:11.575 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.591978739Z", 2020-10-05T12:10:11.575 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:11.575 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:11.575 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:11.575 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:11.576 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.576 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:11.576 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_JeOdsp16bJHA-tsXiBsp4SN", 2020-10-05T12:10:11.576 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:11.576 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.576 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:11.577 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:11.577 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.577 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.577 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.577 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:11.577 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.596105_60.1", 2020-10-05T12:10:11.578 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.578 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-43:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.2", 2020-10-05T12:10:11.578 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.596105556Z", 2020-10-05T12:10:11.578 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:11.578 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:11.578 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:11.579 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:11.579 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.579 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:11.579 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_JeOdsp16bJHA-tsXiBsp4SN", 2020-10-05T12:10:11.579 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:11.579 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.580 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:11.580 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:11.580 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.580 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.580 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.580 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:11.581 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.597958_61.1", 2020-10-05T12:10:11.581 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:11.581 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-43", 2020-10-05T12:10:11.581 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.597958596Z", 2020-10-05T12:10:11.581 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:11.581 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:11.582 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:11.582 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:11.582 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.582 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:11.582 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Mw5yAqo9Pay2liJbEuAFLKY", 2020-10-05T12:10:11.582 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:11.583 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.583 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:11.583 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:11.583 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.583 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.583 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.584 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:11.584 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.601888_62.1", 2020-10-05T12:10:11.584 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:11.584 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-43", 2020-10-05T12:10:11.584 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.601888049Z", 2020-10-05T12:10:11.584 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:11.585 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:11.585 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:11.585 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:11.585 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.585 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:11.585 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Mw5yAqo9Pay2liJbEuAFLKY", 2020-10-05T12:10:11.585 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:11.586 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:11.586 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:11.586 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:11.597 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.597 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.598 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:11.598 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:10:11.598 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:11.599 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:11.600 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period de1ec5d2-2844-47c8-bc1d-b6fc2f043687 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:11.656 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:11.884 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2020-10-05T12:10:11.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.515010_55.1", 2020-10-05T12:10:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.886 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-42:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.1", 2020-10-05T12:10:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.515010710Z", 2020-10-05T12:10:11.887 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.889 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pwyyshAuQicrUlLN4I3O3nj", 2020-10-05T12:10:11.890 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.521580_56.1", 2020-10-05T12:10:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.893 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-42:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.1", 2020-10-05T12:10:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.521580823Z", 2020-10-05T12:10:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pwyyshAuQicrUlLN4I3O3nj", 2020-10-05T12:10:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.523478_57.1", 2020-10-05T12:10:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-42", 2020-10-05T12:10:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.523478837Z", 2020-10-05T12:10:11.896 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_T-W7uOlao6VmfbAEfQE0jWL", 2020-10-05T12:10:11.897 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.528547_58.1", 2020-10-05T12:10:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-42", 2020-10-05T12:10:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.528547324Z", 2020-10-05T12:10:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.899 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_T-W7uOlao6VmfbAEfQE0jWL", 2020-10-05T12:10:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.900 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.591978_59.1", 2020-10-05T12:10:11.901 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-43:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.2", 2020-10-05T12:10:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.591978739Z", 2020-10-05T12:10:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.903 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_JeOdsp16bJHA-tsXiBsp4SN", 2020-10-05T12:10:11.903 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.903 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.903 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.596105_60.1", 2020-10-05T12:10:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-43:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.2", 2020-10-05T12:10:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.596105556Z", 2020-10-05T12:10:11.905 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.905 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.905 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.905 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.906 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.906 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_JeOdsp16bJHA-tsXiBsp4SN", 2020-10-05T12:10:11.906 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.906 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.906 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.597958_61.1", 2020-10-05T12:10:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-43", 2020-10-05T12:10:11.907 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.597958596Z", 2020-10-05T12:10:11.908 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.908 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.908 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.909 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Mw5yAqo9Pay2liJbEuAFLKY", 2020-10-05T12:10:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:11.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.601888_62.1", 2020-10-05T12:10:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-43", 2020-10-05T12:10:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.601888049Z", 2020-10-05T12:10:11.911 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Mw5yAqo9Pay2liJbEuAFLKY", 2020-10-05T12:10:11.912 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:11.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:11.913 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:11.913 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:11.916 INFO:teuthology.orchestra.run.smithi081.stdout:] 2020-10-05T12:10:11.918 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:11.919 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:11.919 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period de1ec5d2-2844-47c8-bc1d-b6fc2f043687 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:11.964 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:11.965 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:12.184 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:10:12.184 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.184 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.515010_55.1", 2020-10-05T12:10:12.185 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:12.185 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-42:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.1", 2020-10-05T12:10:12.185 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.515010710Z", 2020-10-05T12:10:12.185 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.185 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.185 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.186 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.186 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.186 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.186 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pwyyshAuQicrUlLN4I3O3nj", 2020-10-05T12:10:12.186 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.186 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.186 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.187 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:12.187 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.187 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.187 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.187 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.187 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.521580_56.1", 2020-10-05T12:10:12.187 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:12.188 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-42:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.1", 2020-10-05T12:10:12.188 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.521580823Z", 2020-10-05T12:10:12.188 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.188 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.188 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.188 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.188 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.189 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.189 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_pwyyshAuQicrUlLN4I3O3nj", 2020-10-05T12:10:12.189 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.189 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.189 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.189 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:12.189 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.190 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.190 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.190 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.190 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.523478_57.1", 2020-10-05T12:10:12.190 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:12.190 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-42", 2020-10-05T12:10:12.191 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.523478837Z", 2020-10-05T12:10:12.191 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.191 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.191 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.191 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.191 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.192 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.192 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_T-W7uOlao6VmfbAEfQE0jWL", 2020-10-05T12:10:12.192 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.192 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.192 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.193 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:12.193 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.193 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.193 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.193 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.194 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.528547_58.1", 2020-10-05T12:10:12.194 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:12.194 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-42", 2020-10-05T12:10:12.194 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.528547324Z", 2020-10-05T12:10:12.194 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.194 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.194 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.195 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.195 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.195 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.195 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_T-W7uOlao6VmfbAEfQE0jWL", 2020-10-05T12:10:12.195 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.195 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.196 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.196 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:12.196 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.196 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.196 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.196 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.196 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.591978_59.1", 2020-10-05T12:10:12.196 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:12.197 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-43:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.2", 2020-10-05T12:10:12.197 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.591978739Z", 2020-10-05T12:10:12.197 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.197 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.197 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.197 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.197 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.198 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.198 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_JeOdsp16bJHA-tsXiBsp4SN", 2020-10-05T12:10:12.198 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.198 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.198 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.198 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:12.199 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.199 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.199 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.199 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.199 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.596105_60.1", 2020-10-05T12:10:12.200 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:12.200 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-43:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.2", 2020-10-05T12:10:12.200 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.596105556Z", 2020-10-05T12:10:12.201 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.201 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.201 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.201 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.202 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.202 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.202 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_JeOdsp16bJHA-tsXiBsp4SN", 2020-10-05T12:10:12.203 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.203 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.203 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.203 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:12.204 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.204 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.204 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.204 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.205 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.597958_61.1", 2020-10-05T12:10:12.205 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:12.205 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-43", 2020-10-05T12:10:12.205 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.597958596Z", 2020-10-05T12:10:12.206 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.206 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.206 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.207 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.207 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.207 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.208 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Mw5yAqo9Pay2liJbEuAFLKY", 2020-10-05T12:10:12.208 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.208 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.208 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.209 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:12.209 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.209 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.209 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.210 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.210 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899738.601888_62.1", 2020-10-05T12:10:12.210 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:12.211 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-43", 2020-10-05T12:10:12.211 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:08:58.601888049Z", 2020-10-05T12:10:12.211 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.211 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.212 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.212 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.212 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.213 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.213 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_Mw5yAqo9Pay2liJbEuAFLKY", 2020-10-05T12:10:12.213 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.213 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.214 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.214 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:12.222 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.223 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.223 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.224 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:10:12.225 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:12.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:12.230 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period de1ec5d2-2844-47c8-bc1d-b6fc2f043687 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:12.273 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:12.508 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2020-10-05T12:10:12.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.515010_55.1", 2020-10-05T12:10:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-42:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.1", 2020-10-05T12:10:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.515010710Z", 2020-10-05T12:10:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:12.509 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pwyyshAuQicrUlLN4I3O3nj", 2020-10-05T12:10:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.510 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.521580_56.1", 2020-10-05T12:10:12.511 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-42:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.1", 2020-10-05T12:10:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.521580823Z", 2020-10-05T12:10:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:12.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_pwyyshAuQicrUlLN4I3O3nj", 2020-10-05T12:10:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:12.513 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.523478_57.1", 2020-10-05T12:10:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-42", 2020-10-05T12:10:12.514 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.523478837Z", 2020-10-05T12:10:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:12.515 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_T-W7uOlao6VmfbAEfQE0jWL", 2020-10-05T12:10:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.528547_58.1", 2020-10-05T12:10:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-42", 2020-10-05T12:10:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.528547324Z", 2020-10-05T12:10:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:12.517 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_T-W7uOlao6VmfbAEfQE0jWL", 2020-10-05T12:10:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:12.519 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.591978_59.1", 2020-10-05T12:10:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-43:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.2", 2020-10-05T12:10:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.591978739Z", 2020-10-05T12:10:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:12.520 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_JeOdsp16bJHA-tsXiBsp4SN", 2020-10-05T12:10:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:12.521 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.596105_60.1", 2020-10-05T12:10:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-43:bdf35e5b-c653-4ef8-994d-7961e459db28.5106.2", 2020-10-05T12:10:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.596105556Z", 2020-10-05T12:10:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_JeOdsp16bJHA-tsXiBsp4SN", 2020-10-05T12:10:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:12.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.597958_61.1", 2020-10-05T12:10:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:12.526 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-43", 2020-10-05T12:10:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.597958596Z", 2020-10-05T12:10:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:12.527 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Mw5yAqo9Pay2liJbEuAFLKY", 2020-10-05T12:10:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:12.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:12.529 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899738.601888_62.1", 2020-10-05T12:10:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-43", 2020-10-05T12:10:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:08:58.601888049Z", 2020-10-05T12:10:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:12.530 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_Mw5yAqo9Pay2liJbEuAFLKY", 2020-10-05T12:10:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:12.531 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:12.535 INFO:teuthology.orchestra.run.smithi081.stdout:] 2020-10-05T12:10:12.536 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:12.537 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:12.538 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 51627dfe-772a-407d-b86d-f398684bbf7f --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:12.580 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:12.580 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:12.810 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:10:12.810 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.810 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.833035_162.1", 2020-10-05T12:10:12.810 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:12.811 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-44:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.1", 2020-10-05T12:10:12.811 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.833035938Z", 2020-10-05T12:10:12.811 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.811 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.811 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.812 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.812 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.812 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.812 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EChavU6WtrosFk6inTi8Gch", 2020-10-05T12:10:12.813 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.813 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.813 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.813 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:12.813 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.813 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.813 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.814 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.814 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.837363_163.1", 2020-10-05T12:10:12.814 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:12.814 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-44:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.1", 2020-10-05T12:10:12.814 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.837363154Z", 2020-10-05T12:10:12.814 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.815 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.815 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.815 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.815 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.815 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.815 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EChavU6WtrosFk6inTi8Gch", 2020-10-05T12:10:12.816 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.816 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.816 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.816 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:12.816 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.816 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.817 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.817 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.817 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.839279_164.1", 2020-10-05T12:10:12.817 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:12.817 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-44", 2020-10-05T12:10:12.817 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.839279626Z", 2020-10-05T12:10:12.817 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.818 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.818 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.818 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.818 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.818 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.818 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_-KsaxNQvhH4eMX1JhdZETW_", 2020-10-05T12:10:12.818 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.819 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.819 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.819 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:12.819 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.819 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.819 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.819 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.820 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.843072_165.1", 2020-10-05T12:10:12.820 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:12.820 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-44", 2020-10-05T12:10:12.820 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.843072893Z", 2020-10-05T12:10:12.820 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.820 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.820 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.821 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.821 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.821 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.821 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_-KsaxNQvhH4eMX1JhdZETW_", 2020-10-05T12:10:12.821 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.821 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.822 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.822 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:12.822 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.822 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.822 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.822 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.823 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.885024_166.1", 2020-10-05T12:10:12.823 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:12.823 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-45:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.2", 2020-10-05T12:10:12.823 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.885024971Z", 2020-10-05T12:10:12.823 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.823 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.823 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.824 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.824 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.824 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.824 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AcGlgo_Qc3r4adwp0Rc2cZh", 2020-10-05T12:10:12.824 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.824 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.824 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.825 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:12.825 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.825 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.825 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.825 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.825 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.889567_167.1", 2020-10-05T12:10:12.825 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:12.826 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-45:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.2", 2020-10-05T12:10:12.826 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.889567648Z", 2020-10-05T12:10:12.826 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.826 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.826 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.826 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.826 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.827 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.827 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AcGlgo_Qc3r4adwp0Rc2cZh", 2020-10-05T12:10:12.827 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.827 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.827 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.827 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:12.828 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.828 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.828 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.828 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.828 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.891638_168.1", 2020-10-05T12:10:12.829 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:12.829 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-45", 2020-10-05T12:10:12.829 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.891638491Z", 2020-10-05T12:10:12.829 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.829 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.830 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.830 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.830 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.830 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.830 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t2C97wKMCTjTL0UgrQExdq3", 2020-10-05T12:10:12.830 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.830 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.831 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.831 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:12.831 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.831 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.831 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.831 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:12.831 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.896592_169.1", 2020-10-05T12:10:12.832 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:12.832 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-45", 2020-10-05T12:10:12.832 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.896592505Z", 2020-10-05T12:10:12.832 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:12.832 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:12.832 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:12.832 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:12.833 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.833 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:12.833 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t2C97wKMCTjTL0UgrQExdq3", 2020-10-05T12:10:12.833 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:12.833 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:12.833 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:12.840 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:12.841 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.841 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.842 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:12.842 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:10:12.844 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:12.845 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:12.846 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 51627dfe-772a-407d-b86d-f398684bbf7f --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:12.897 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:12.898 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:13.119 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2020-10-05T12:10:13.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.120 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.833035_162.1", 2020-10-05T12:10:13.120 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:13.120 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-44:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.1", 2020-10-05T12:10:13.120 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.833035938Z", 2020-10-05T12:10:13.120 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.120 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.120 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.121 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.121 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.121 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EChavU6WtrosFk6inTi8Gch", 2020-10-05T12:10:13.121 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.121 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.122 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:13.122 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.122 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.122 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.837363_163.1", 2020-10-05T12:10:13.122 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:13.123 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-44:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.1", 2020-10-05T12:10:13.123 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.837363154Z", 2020-10-05T12:10:13.123 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.123 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.123 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.123 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.124 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.124 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EChavU6WtrosFk6inTi8Gch", 2020-10-05T12:10:13.124 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.124 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.124 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:13.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.125 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.839279_164.1", 2020-10-05T12:10:13.125 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:13.125 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-44", 2020-10-05T12:10:13.125 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.839279626Z", 2020-10-05T12:10:13.126 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.126 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.126 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.126 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.126 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.126 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_-KsaxNQvhH4eMX1JhdZETW_", 2020-10-05T12:10:13.126 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.127 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.127 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:13.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.128 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.843072_165.1", 2020-10-05T12:10:13.128 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:13.128 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-44", 2020-10-05T12:10:13.128 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.843072893Z", 2020-10-05T12:10:13.128 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.128 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.128 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_-KsaxNQvhH4eMX1JhdZETW_", 2020-10-05T12:10:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.885024_166.1", 2020-10-05T12:10:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-45:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.2", 2020-10-05T12:10:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.885024971Z", 2020-10-05T12:10:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AcGlgo_Qc3r4adwp0Rc2cZh", 2020-10-05T12:10:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.889567_167.1", 2020-10-05T12:10:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-45:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.2", 2020-10-05T12:10:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.889567648Z", 2020-10-05T12:10:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AcGlgo_Qc3r4adwp0Rc2cZh", 2020-10-05T12:10:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.891638_168.1", 2020-10-05T12:10:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-45", 2020-10-05T12:10:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.891638491Z", 2020-10-05T12:10:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t2C97wKMCTjTL0UgrQExdq3", 2020-10-05T12:10:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.896592_169.1", 2020-10-05T12:10:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-45", 2020-10-05T12:10:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.896592505Z", 2020-10-05T12:10:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t2C97wKMCTjTL0UgrQExdq3", 2020-10-05T12:10:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.152 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:13.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.154 INFO:teuthology.orchestra.run.smithi081.stdout:] 2020-10-05T12:10:13.157 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:13.157 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:13.158 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 51627dfe-772a-407d-b86d-f398684bbf7f --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:13.199 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:13.200 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:13.427 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:10:13.427 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:13.428 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.833035_162.1", 2020-10-05T12:10:13.428 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:13.428 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-44:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.1", 2020-10-05T12:10:13.428 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.833035938Z", 2020-10-05T12:10:13.428 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:13.428 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:13.429 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:13.429 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:13.429 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.429 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:13.429 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EChavU6WtrosFk6inTi8Gch", 2020-10-05T12:10:13.429 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:13.429 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.430 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:13.430 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:13.430 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.430 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.430 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.430 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:13.430 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.837363_163.1", 2020-10-05T12:10:13.431 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:13.431 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-44:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.1", 2020-10-05T12:10:13.431 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.837363154Z", 2020-10-05T12:10:13.431 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:13.431 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:13.431 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:13.431 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:13.432 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.432 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:13.432 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_EChavU6WtrosFk6inTi8Gch", 2020-10-05T12:10:13.432 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:13.432 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.432 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:13.432 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:13.432 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.433 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.433 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.433 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:13.433 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.839279_164.1", 2020-10-05T12:10:13.433 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:13.433 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-44", 2020-10-05T12:10:13.433 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.839279626Z", 2020-10-05T12:10:13.434 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:13.434 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:13.434 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:13.434 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:13.434 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.434 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:13.434 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_-KsaxNQvhH4eMX1JhdZETW_", 2020-10-05T12:10:13.435 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:13.435 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.435 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:13.435 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:13.435 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.435 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.435 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.436 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:13.436 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.843072_165.1", 2020-10-05T12:10:13.436 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:13.436 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-44", 2020-10-05T12:10:13.436 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.843072893Z", 2020-10-05T12:10:13.436 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:13.436 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:13.436 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:13.437 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:13.437 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.437 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:13.437 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_-KsaxNQvhH4eMX1JhdZETW_", 2020-10-05T12:10:13.437 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:13.437 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.437 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:13.438 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:13.438 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.438 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.438 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.439 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:13.439 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.885024_166.1", 2020-10-05T12:10:13.439 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:13.439 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-45:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.2", 2020-10-05T12:10:13.439 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.885024971Z", 2020-10-05T12:10:13.439 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:13.439 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:13.439 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:13.440 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:13.440 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.440 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:13.440 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AcGlgo_Qc3r4adwp0Rc2cZh", 2020-10-05T12:10:13.440 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:13.440 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.440 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:13.441 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:13.441 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.441 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.441 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.441 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:13.441 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.889567_167.1", 2020-10-05T12:10:13.441 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket.instance", 2020-10-05T12:10:13.442 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-45:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.2", 2020-10-05T12:10:13.442 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.889567648Z", 2020-10-05T12:10:13.442 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:13.442 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:13.442 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:13.442 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:13.442 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.443 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:13.443 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_AcGlgo_Qc3r4adwp0Rc2cZh", 2020-10-05T12:10:13.443 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:13.443 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.443 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:13.443 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:13.443 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.444 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.444 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.444 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:13.444 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.891638_168.1", 2020-10-05T12:10:13.444 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:13.444 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-45", 2020-10-05T12:10:13.444 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.891638491Z", 2020-10-05T12:10:13.444 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:13.445 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:13.445 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:13.445 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:13.445 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.445 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:13.445 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t2C97wKMCTjTL0UgrQExdq3", 2020-10-05T12:10:13.445 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:13.446 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.446 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:13.446 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "write" 2020-10-05T12:10:13.446 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.446 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.446 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.446 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:13.447 INFO:teuthology.orchestra.run.smithi158.stdout: "id": "1_1601899799.896592_169.1", 2020-10-05T12:10:13.447 INFO:teuthology.orchestra.run.smithi158.stdout: "section": "bucket", 2020-10-05T12:10:13.447 INFO:teuthology.orchestra.run.smithi158.stdout: "name": "dzadif-45", 2020-10-05T12:10:13.447 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:09:59.896592505Z", 2020-10-05T12:10:13.447 INFO:teuthology.orchestra.run.smithi158.stdout: "data": { 2020-10-05T12:10:13.447 INFO:teuthology.orchestra.run.smithi158.stdout: "read_version": { 2020-10-05T12:10:13.447 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "", 2020-10-05T12:10:13.447 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 0 2020-10-05T12:10:13.448 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.448 INFO:teuthology.orchestra.run.smithi158.stdout: "write_version": { 2020-10-05T12:10:13.448 INFO:teuthology.orchestra.run.smithi158.stdout: "tag": "_t2C97wKMCTjTL0UgrQExdq3", 2020-10-05T12:10:13.448 INFO:teuthology.orchestra.run.smithi158.stdout: "ver": 1 2020-10-05T12:10:13.448 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:13.448 INFO:teuthology.orchestra.run.smithi158.stdout: "status": { 2020-10-05T12:10:13.459 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "complete" 2020-10-05T12:10:13.459 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.460 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.460 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:13.460 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:10:13.462 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:13.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:13.463 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 51627dfe-772a-407d-b86d-f398684bbf7f --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:13.507 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:13.508 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:13.730 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2020-10-05T12:10:13.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.731 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.833035_162.1", 2020-10-05T12:10:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-44:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.1", 2020-10-05T12:10:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.833035938Z", 2020-10-05T12:10:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.733 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EChavU6WtrosFk6inTi8Gch", 2020-10-05T12:10:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.735 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.737 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.837363_163.1", 2020-10-05T12:10:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-44:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.1", 2020-10-05T12:10:13.738 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.837363154Z", 2020-10-05T12:10:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.739 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.740 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.740 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.741 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_EChavU6WtrosFk6inTi8Gch", 2020-10-05T12:10:13.741 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.741 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.742 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:13.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.743 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.839279_164.1", 2020-10-05T12:10:13.744 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:13.744 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-44", 2020-10-05T12:10:13.744 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.839279626Z", 2020-10-05T12:10:13.744 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.745 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.745 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.746 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.746 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.746 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_-KsaxNQvhH4eMX1JhdZETW_", 2020-10-05T12:10:13.747 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.747 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.747 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:13.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.749 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.843072_165.1", 2020-10-05T12:10:13.749 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:13.749 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-44", 2020-10-05T12:10:13.749 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.843072893Z", 2020-10-05T12:10:13.749 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.749 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.750 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.750 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.751 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_-KsaxNQvhH4eMX1JhdZETW_", 2020-10-05T12:10:13.751 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.751 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.752 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:13.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.753 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.885024_166.1", 2020-10-05T12:10:13.753 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:13.753 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-45:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.2", 2020-10-05T12:10:13.753 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.885024971Z", 2020-10-05T12:10:13.753 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.753 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.754 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.754 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.754 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.754 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AcGlgo_Qc3r4adwp0Rc2cZh", 2020-10-05T12:10:13.755 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.755 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.755 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:13.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.756 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.756 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.889567_167.1", 2020-10-05T12:10:13.756 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket.instance", 2020-10-05T12:10:13.757 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-45:35a06950-5b24-42ca-86ff-3dc913eb1ccc.5149.2", 2020-10-05T12:10:13.757 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.889567648Z", 2020-10-05T12:10:13.757 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.757 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.757 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.758 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.758 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_AcGlgo_Qc3r4adwp0Rc2cZh", 2020-10-05T12:10:13.758 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:13.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.891638_168.1", 2020-10-05T12:10:13.760 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-45", 2020-10-05T12:10:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.891638491Z", 2020-10-05T12:10:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.761 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t2C97wKMCTjTL0UgrQExdq3", 2020-10-05T12:10:13.762 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "write" 2020-10-05T12:10:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: "id": "1_1601899799.896592_169.1", 2020-10-05T12:10:13.764 INFO:teuthology.orchestra.run.smithi081.stdout: "section": "bucket", 2020-10-05T12:10:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dzadif-45", 2020-10-05T12:10:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:09:59.896592505Z", 2020-10-05T12:10:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "data": { 2020-10-05T12:10:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "read_version": { 2020-10-05T12:10:13.765 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "", 2020-10-05T12:10:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 0 2020-10-05T12:10:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: "write_version": { 2020-10-05T12:10:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "_t2C97wKMCTjTL0UgrQExdq3", 2020-10-05T12:10:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: "ver": 1 2020-10-05T12:10:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:13.767 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2020-10-05T12:10:13.768 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "complete" 2020-10-05T12:10:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:13.770 INFO:teuthology.orchestra.run.smithi081.stdout:] 2020-10-05T12:10:13.770 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:10:13.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:10:13.772 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T12:10:13.806 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:13.807 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:14.113 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:10:14.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:10:14.115 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2020-10-05T12:10:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:14.598 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:10:14.599 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:10:14.599 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T12:10:14.635 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:14.635 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:14.903 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:10:14.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:10:14.904 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2020-10-05T12:10:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:15.335 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:15.336 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:15.336 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period eb044115-4632-4a42-8790-5052d87ef1c6 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:15.379 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:15.379 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:15.623 INFO:teuthology.orchestra.run.smithi158.stdout:[] 2020-10-05T12:10:15.625 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:15.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:15.627 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period eb044115-4632-4a42-8790-5052d87ef1c6 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:15.664 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:15.928 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2020-10-05T12:10:15.930 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:15.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:15.931 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period eb044115-4632-4a42-8790-5052d87ef1c6 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:15.970 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:15.971 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:16.241 INFO:teuthology.orchestra.run.smithi158.stdout:[] 2020-10-05T12:10:16.243 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:16.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'eb044115-4632-4a42-8790-5052d87ef1c6', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:16.244 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period eb044115-4632-4a42-8790-5052d87ef1c6 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:16.281 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:16.544 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2020-10-05T12:10:16.546 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:16.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:16.547 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period de1ec5d2-2844-47c8-bc1d-b6fc2f043687 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:16.585 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:16.585 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:16.839 INFO:teuthology.orchestra.run.smithi158.stdout:[] 2020-10-05T12:10:16.841 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:16.841 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:16.842 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period de1ec5d2-2844-47c8-bc1d-b6fc2f043687 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:16.881 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:16.881 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:17.137 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2020-10-05T12:10:17.139 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:17.140 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:17.140 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period de1ec5d2-2844-47c8-bc1d-b6fc2f043687 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:17.178 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:17.178 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:17.440 INFO:teuthology.orchestra.run.smithi158.stdout:[] 2020-10-05T12:10:17.442 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:17.443 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'de1ec5d2-2844-47c8-bc1d-b6fc2f043687', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:17.443 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period de1ec5d2-2844-47c8-bc1d-b6fc2f043687 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:17.743 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2020-10-05T12:10:17.745 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:17.746 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:17.746 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 51627dfe-772a-407d-b86d-f398684bbf7f --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:17.784 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:17.785 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:18.059 INFO:teuthology.orchestra.run.smithi158.stdout:[] 2020-10-05T12:10:18.061 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:18.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:18.062 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 51627dfe-772a-407d-b86d-f398684bbf7f --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:18.101 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:18.102 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:18.377 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2020-10-05T12:10:18.379 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:18.380 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:18.380 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 51627dfe-772a-407d-b86d-f398684bbf7f --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:18.419 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:18.419 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:18.686 INFO:teuthology.orchestra.run.smithi158.stdout:[] 2020-10-05T12:10:18.689 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:18.689 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '51627dfe-772a-407d-b86d-f398684bbf7f', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:18.690 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 51627dfe-772a-407d-b86d-f398684bbf7f --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:18.729 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:18.729 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:18.989 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2020-10-05T12:10:18.991 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_multi_period_incremental_sync ... ok 2020-10-05T12:10:18.992 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=dzadif-46 2020-10-05T12:10:19.035 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=dzadif-47 2020-10-05T12:10:19.111 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=dzadif-48 2020-10-05T12:10:19.256 INFO:tasks.rgw.c1.client.1.smithi158.stdout:2020-10-05T12:10:19.250+0000 7f5870ff1700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2020-10-05T12:10:19.322 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:19.323 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:19.323 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:19.359 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:19.360 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:19.553 INFO:teuthology.orchestra.run.smithi158.stderr:No --period given, using current period=51627dfe-772a-407d-b86d-f398684bbf7f 2020-10-05T12:10:19.579 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:10:19.580 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:19.580 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899819.147330_199.1", 2020-10-05T12:10:19.580 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:10:19.147330Z" 2020-10-05T12:10:19.581 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:19.581 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:19.581 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:10:19.582 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:10:19.582 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:19.582 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:19.582 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:10:19.583 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:10:19.583 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:19.583 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:19.583 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:10:19.583 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "0.000000" 2020-10-05T12:10:19.584 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:19.584 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:10:19.585 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2020-10-05T12:10:19.585 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:19.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:19.587 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:19.891 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:10:19.892 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:10:19.892 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:10:19.892 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:10:19.892 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:10:19.892 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "51627dfe-772a-407d-b86d-f398684bbf7f", 2020-10-05T12:10:19.892 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 4 2020-10-05T12:10:19.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:19.893 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:10:19.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:19.893 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:10:19.893 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:19.894 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:19.894 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899819.147330_199.1", 2020-10-05T12:10:19.894 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:19.894 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:10:19.894 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:19.894 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:10:19.147330Z", 2020-10-05T12:10:19.895 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 4 2020-10-05T12:10:19.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:19.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:19.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:19.895 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:10:19.895 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:19.895 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:19.895 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:10:19.896 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:19.896 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:19.896 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:19.896 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:10:19.896 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:10:19.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:19.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:19.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:19.897 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:10:19.897 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:19.897 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:19.897 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:10:19.897 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:19.897 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:19.898 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:19.898 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:10:19.898 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:10:19.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:19.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:19.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:19.898 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:10:19.899 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:19.899 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:19.899 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:10:19.899 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:19.899 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:19.899 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:19.899 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:10:19.900 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:10:19.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:19.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:19.900 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:10:19.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:19.900 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:10:19.900 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:10:19.901 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:10:19.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:19.901 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:10:19.902 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2020-10-05T12:10:19.902 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2020-10-05T12:10:19.903 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:19.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:19.903 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:19.945 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:19.945 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:20.198 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:10:20.198 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:10:20.199 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:10:20.199 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:10:20.199 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:10:20.200 INFO:teuthology.orchestra.run.smithi158.stdout: "period": "51627dfe-772a-407d-b86d-f398684bbf7f", 2020-10-05T12:10:20.200 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 4 2020-10-05T12:10:20.200 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:20.200 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:10:20.201 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:20.201 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:10:20.201 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:20.202 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:10:20.202 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899819.147330_199.1", 2020-10-05T12:10:20.202 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:20.202 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 1, 2020-10-05T12:10:20.203 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:20.203 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:10:19.147330Z", 2020-10-05T12:10:20.203 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 4 2020-10-05T12:10:20.204 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:20.204 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:20.204 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:20.205 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:10:20.205 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:20.205 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:10:20.205 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:10:20.206 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:20.206 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:20.206 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:20.207 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:10:20.207 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:10:20.207 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:20.207 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:20.208 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:20.208 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:10:20.208 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:20.209 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:10:20.209 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:10:20.209 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:20.209 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:20.210 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:20.210 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:10:20.210 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:10:20.211 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:20.211 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:20.211 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:20.211 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:10:20.212 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:20.212 INFO:teuthology.orchestra.run.smithi158.stdout: "state": 1, 2020-10-05T12:10:20.212 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "", 2020-10-05T12:10:20.213 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:20.213 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:20.213 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:20.213 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "0.000000", 2020-10-05T12:10:20.214 INFO:teuthology.orchestra.run.smithi158.stdout: "realm_epoch": 2 2020-10-05T12:10:20.214 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:20.214 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:20.215 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:10:20.215 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:20.215 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:10:20.216 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 1, 2020-10-05T12:10:20.216 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 1 2020-10-05T12:10:20.216 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:20.216 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:10:20.218 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2020-10-05T12:10:20.219 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2020-10-05T12:10:20.219 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:20.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:20.221 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:20.513 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:10:20.513 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:10:20.513 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:10:20.514 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:10:20.514 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:10:20.514 INFO:teuthology.orchestra.run.smithi081.stdout: "period": "51627dfe-772a-407d-b86d-f398684bbf7f", 2020-10-05T12:10:20.514 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 4 2020-10-05T12:10:20.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:20.514 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:10:20.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:20.515 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:10:20.515 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:20.515 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:20.515 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899819.147330_199.1", 2020-10-05T12:10:20.515 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:20.515 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 1, 2020-10-05T12:10:20.516 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:20.516 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:10:19.147330Z", 2020-10-05T12:10:20.516 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 4 2020-10-05T12:10:20.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:20.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:20.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:20.516 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:10:20.517 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:20.517 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:20.517 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "1_1601899142.535244_102.1", 2020-10-05T12:10:20.517 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:20.517 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:20.517 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:20.518 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T11:59:02.535244Z", 2020-10-05T12:10:20.518 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:10:20.518 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:10:20.519 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:10:20.520 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:10:20.521 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:10:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:20.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:10:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:20.523 INFO:teuthology.orchestra.run.smithi081.stdout: "state": 1, 2020-10-05T12:10:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "", 2020-10-05T12:10:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "0.000000", 2020-10-05T12:10:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: "realm_epoch": 2 2020-10-05T12:10:20.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:10:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:10:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 1, 2020-10-05T12:10:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 1 2020-10-05T12:10:20.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:20.528 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:10:20.529 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2020-10-05T12:10:20.530 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:20.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:20.531 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:20.577 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:20.578 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:20.828 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:10:20.829 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:20.829 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:10:20.829 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:03:19.033064Z" 2020-10-05T12:10:20.829 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:20.829 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:20.829 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:20.830 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:07:50.555583Z" 2020-10-05T12:10:20.830 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:20.830 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:20.830 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:10:20.830 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:02:44.575161Z" 2020-10-05T12:10:20.830 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:20.830 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:20.831 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000003835", 2020-10-05T12:10:20.831 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:10:20.362392Z" 2020-10-05T12:10:20.831 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:20.831 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:10:20.832 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2020-10-05T12:10:20.833 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:20.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:20.834 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:20.875 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:20.876 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:21.142 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:10:21.143 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:10:21.143 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:10:21.143 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:10:21.143 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:10:21.144 INFO:teuthology.orchestra.run.smithi081.stdout: "instance_id": 8907536789404842802 2020-10-05T12:10:21.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:21.144 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:10:21.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:21.144 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:10:21.144 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:21.145 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:10:21.145 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:10:21.145 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:21.145 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:21.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:21.146 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:19.033064Z" 2020-10-05T12:10:21.146 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:21.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:21.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:21.146 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:10:21.146 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:21.147 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:10:21.147 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:21.147 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:21.147 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:21.147 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:21.147 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.555583Z" 2020-10-05T12:10:21.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:21.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:21.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:21.148 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:10:21.148 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:21.148 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:10:21.149 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:10:21.149 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:21.149 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:21.149 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:21.149 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:02:44.575161Z" 2020-10-05T12:10:21.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:21.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:21.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:21.150 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:10:21.150 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:21.151 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:10:21.151 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000003835", 2020-10-05T12:10:21.151 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:21.151 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:21.151 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:21.151 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:10:20.362392Z" 2020-10-05T12:10:21.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:21.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:21.152 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:10:21.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:21.153 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:10:21.154 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 0, 2020-10-05T12:10:21.154 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 0 2020-10-05T12:10:21.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:21.155 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:10:21.156 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2020-10-05T12:10:21.157 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:21.158 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:21.159 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:21.199 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:21.200 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:21.443 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:10:21.443 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:21.443 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:10:21.444 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:03:19.033064Z" 2020-10-05T12:10:21.444 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:21.444 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:21.444 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:21.444 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:07:50.555583Z" 2020-10-05T12:10:21.444 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:21.444 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:21.445 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:10:21.445 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:02:44.575161Z" 2020-10-05T12:10:21.445 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:21.445 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:21.445 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000003835", 2020-10-05T12:10:21.445 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:10:20.362392Z" 2020-10-05T12:10:21.445 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:21.445 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:10:21.446 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2020-10-05T12:10:21.447 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:21.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:21.448 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:21.529 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:21.530 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:21.805 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:10:21.805 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:10:21.806 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:10:21.806 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:10:21.806 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:10:21.806 INFO:teuthology.orchestra.run.smithi158.stdout: "instance_id": 15500224595871940729 2020-10-05T12:10:21.806 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:21.806 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:10:21.806 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:21.807 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:10:21.807 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:21.807 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:21.807 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:10:21.807 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:21.807 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:21.807 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:21.808 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:19.033064Z" 2020-10-05T12:10:21.808 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:21.808 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:21.808 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:21.808 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:10:21.808 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:21.808 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:21.809 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:21.809 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:21.809 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:21.809 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:21.809 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.555583Z" 2020-10-05T12:10:21.809 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:21.809 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:21.810 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:21.810 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:10:21.810 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:21.810 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:21.810 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:10:21.810 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:21.810 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:21.811 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:21.811 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:02:44.575161Z" 2020-10-05T12:10:21.811 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:21.811 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:21.811 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:21.811 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:10:21.811 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:21.811 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:21.812 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000003835", 2020-10-05T12:10:21.812 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:21.812 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:21.812 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:21.812 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:10:20.362392Z" 2020-10-05T12:10:21.812 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:21.812 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:21.813 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:10:21.813 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:21.813 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:10:21.813 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 0, 2020-10-05T12:10:21.813 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 0 2020-10-05T12:10:21.813 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:21.813 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:10:21.814 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2020-10-05T12:10:21.815 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:21.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:21.816 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:21.898 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:21.898 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:22.156 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:10:22.157 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:22.157 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:10:22.157 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:03:19.033064Z" 2020-10-05T12:10:22.158 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:22.158 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:22.158 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:22.158 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:07:50.555583Z" 2020-10-05T12:10:22.158 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:22.158 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:22.159 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:10:22.159 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:02:44.575161Z" 2020-10-05T12:10:22.159 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:22.159 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:22.159 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000003835", 2020-10-05T12:10:22.159 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:10:20.362392Z" 2020-10-05T12:10:22.159 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:22.160 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:10:22.160 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone4 source_zone=test-zone1 2020-10-05T12:10:22.161 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:22.161 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:22.162 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:22.205 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:22.206 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:22.567 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:10:22.567 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:10:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:10:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:10:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:10:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: "instance_id": 6281930865008582443 2020-10-05T12:10:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:22.568 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:10:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:10:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:10:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:10:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:22.569 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:19.033064Z" 2020-10-05T12:10:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:10:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:10:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.555583Z" 2020-10-05T12:10:22.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:10:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:10:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:10:22.572 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:02:44.575161Z" 2020-10-05T12:10:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:10:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:10:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000003835", 2020-10-05T12:10:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:22.574 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:10:20.362392Z" 2020-10-05T12:10:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:10:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:10:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 0, 2020-10-05T12:10:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 0 2020-10-05T12:10:22.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:22.576 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:10:22.577 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone4 source_zone=test-zone1 2020-10-05T12:10:22.577 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:22.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:22.578 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:22.660 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:22.660 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:22.913 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2020-10-05T12:10:22.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:10:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:03:41.218954Z" 2020-10-05T12:10:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:07:50.565784Z" 2020-10-05T12:10:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000002640", 2020-10-05T12:10:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:02:35.209070Z" 2020-10-05T12:10:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000003968", 2020-10-05T12:10:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:10:20.382140Z" 2020-10-05T12:10:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:22.920 INFO:teuthology.orchestra.run.smithi081.stdout:] 2020-10-05T12:10:22.921 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2020-10-05T12:10:22.922 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:22.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:22.923 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:22.965 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:22.965 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:23.222 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:10:23.222 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:10:23.222 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:10:23.223 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:10:23.223 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:10:23.223 INFO:teuthology.orchestra.run.smithi158.stdout: "instance_id": 10955443425776689827 2020-10-05T12:10:23.223 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:23.223 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:10:23.223 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:23.223 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:10:23.224 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:23.224 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:23.224 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:10:23.224 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:23.224 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:23.224 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:23.224 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:41.218954Z" 2020-10-05T12:10:23.225 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:23.225 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:23.225 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:23.225 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:10:23.225 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:23.225 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:23.225 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:23.225 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:23.226 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:23.226 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:23.226 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.565784Z" 2020-10-05T12:10:23.226 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:23.226 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:23.226 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:23.227 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:10:23.227 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:23.227 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:23.227 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002640", 2020-10-05T12:10:23.227 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:23.228 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:23.228 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:23.228 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:02:35.209070Z" 2020-10-05T12:10:23.228 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:23.228 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:23.228 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:23.228 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:10:23.228 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:23.229 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:23.229 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000003968", 2020-10-05T12:10:23.229 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:23.229 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:23.229 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:23.229 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:10:20.382140Z" 2020-10-05T12:10:23.229 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:23.230 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:23.230 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:10:23.230 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:23.230 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:10:23.230 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 0, 2020-10-05T12:10:23.230 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 0 2020-10-05T12:10:23.230 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:23.231 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:10:23.231 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2020-10-05T12:10:23.232 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:23.232 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:23.233 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:23.272 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:23.272 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:23.538 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2020-10-05T12:10:23.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:23.538 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:10:23.539 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:03:41.218954Z" 2020-10-05T12:10:23.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:23.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:23.540 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:23.540 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:07:50.565784Z" 2020-10-05T12:10:23.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:23.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:23.541 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000002640", 2020-10-05T12:10:23.541 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:02:35.209070Z" 2020-10-05T12:10:23.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:23.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:23.542 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000003968", 2020-10-05T12:10:23.542 INFO:teuthology.orchestra.run.smithi081.stdout: "last_update": "2020-10-05T12:10:20.382140Z" 2020-10-05T12:10:23.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:23.543 INFO:teuthology.orchestra.run.smithi081.stdout:] 2020-10-05T12:10:23.544 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone2 2020-10-05T12:10:23.545 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:23.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:23.546 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:23.589 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:23.589 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:23.856 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:10:23.857 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:10:23.857 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:10:23.857 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:10:23.857 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:10:23.857 INFO:teuthology.orchestra.run.smithi158.stdout: "instance_id": 2541289269092616888 2020-10-05T12:10:23.858 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:23.858 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:10:23.858 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:23.858 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:10:23.858 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:23.858 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:23.858 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:10:23.859 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:23.859 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:23.859 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:23.859 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:41.218954Z" 2020-10-05T12:10:23.859 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:23.860 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:23.860 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:23.860 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:10:23.860 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:23.860 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:23.860 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:23.860 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:23.861 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:23.861 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:23.861 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.565784Z" 2020-10-05T12:10:23.861 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:23.861 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:23.861 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:23.862 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:10:23.862 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:23.862 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:23.862 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002640", 2020-10-05T12:10:23.862 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:23.862 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:23.863 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:23.863 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:02:35.209070Z" 2020-10-05T12:10:23.863 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:23.863 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:23.863 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:23.863 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:10:23.863 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:23.864 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:23.864 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000003968", 2020-10-05T12:10:23.864 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:23.864 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:23.864 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:23.864 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:10:20.382140Z" 2020-10-05T12:10:23.864 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:23.865 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:23.865 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:10:23.865 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:23.865 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:10:23.865 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 0, 2020-10-05T12:10:23.865 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 0 2020-10-05T12:10:23.865 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:23.866 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:10:23.866 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone2 2020-10-05T12:10:23.867 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:23.867 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:23.868 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:23.947 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:23.947 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:24.207 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:10:24.208 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:24.208 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005167", 2020-10-05T12:10:24.208 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:03:41.181933Z" 2020-10-05T12:10:24.209 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:24.209 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:24.209 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:24.209 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:07:50.428696Z" 2020-10-05T12:10:24.210 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:24.210 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:24.210 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:10:24.210 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:02:44.564209Z" 2020-10-05T12:10:24.210 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:24.210 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:24.210 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000003835", 2020-10-05T12:10:24.211 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:10:19.428759Z" 2020-10-05T12:10:24.211 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:24.211 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:10:24.212 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone3 2020-10-05T12:10:24.212 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone3', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:24.213 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone3', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:24.213 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone3 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:24.295 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:24.296 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:24.546 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2020-10-05T12:10:24.546 INFO:teuthology.orchestra.run.smithi158.stdout: "sync_status": { 2020-10-05T12:10:24.547 INFO:teuthology.orchestra.run.smithi158.stdout: "info": { 2020-10-05T12:10:24.547 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "sync", 2020-10-05T12:10:24.547 INFO:teuthology.orchestra.run.smithi158.stdout: "num_shards": 4, 2020-10-05T12:10:24.547 INFO:teuthology.orchestra.run.smithi158.stdout: "instance_id": 4570483896491121822 2020-10-05T12:10:24.547 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:24.547 INFO:teuthology.orchestra.run.smithi158.stdout: "markers": [ 2020-10-05T12:10:24.547 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:24.548 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 0, 2020-10-05T12:10:24.548 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:24.548 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:24.548 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005167", 2020-10-05T12:10:24.548 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:24.548 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:24.548 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:24.549 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:03:41.181933Z" 2020-10-05T12:10:24.549 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:24.549 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:24.549 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:24.549 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 1, 2020-10-05T12:10:24.549 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:24.549 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:24.550 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:24.550 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:24.550 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:24.550 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:24.550 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:07:50.428696Z" 2020-10-05T12:10:24.550 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:24.550 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:24.551 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:24.551 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 2, 2020-10-05T12:10:24.551 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:24.551 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:24.551 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:10:24.551 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:24.551 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:24.552 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:24.552 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:02:44.564209Z" 2020-10-05T12:10:24.552 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:24.552 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:24.552 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:24.552 INFO:teuthology.orchestra.run.smithi158.stdout: "key": 3, 2020-10-05T12:10:24.552 INFO:teuthology.orchestra.run.smithi158.stdout: "val": { 2020-10-05T12:10:24.553 INFO:teuthology.orchestra.run.smithi158.stdout: "status": "incremental-sync", 2020-10-05T12:10:24.553 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000003835", 2020-10-05T12:10:24.553 INFO:teuthology.orchestra.run.smithi158.stdout: "next_step_marker": "", 2020-10-05T12:10:24.553 INFO:teuthology.orchestra.run.smithi158.stdout: "total_entries": 0, 2020-10-05T12:10:24.553 INFO:teuthology.orchestra.run.smithi158.stdout: "pos": 0, 2020-10-05T12:10:24.553 INFO:teuthology.orchestra.run.smithi158.stdout: "timestamp": "2020-10-05T12:10:19.428759Z" 2020-10-05T12:10:24.553 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:24.554 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:24.554 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2020-10-05T12:10:24.554 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:24.554 INFO:teuthology.orchestra.run.smithi158.stdout: "full_sync": { 2020-10-05T12:10:24.554 INFO:teuthology.orchestra.run.smithi158.stdout: "total": 0, 2020-10-05T12:10:24.554 INFO:teuthology.orchestra.run.smithi158.stdout: "complete": 0 2020-10-05T12:10:24.555 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:24.555 INFO:teuthology.orchestra.run.smithi158.stdout:} 2020-10-05T12:10:24.556 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone3 2020-10-05T12:10:24.556 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:24.557 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:24.557 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:24.634 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:24.635 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:24.891 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:10:24.891 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:24.891 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005167", 2020-10-05T12:10:24.891 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:03:41.181933Z" 2020-10-05T12:10:24.892 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:24.892 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:24.892 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:24.892 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:07:50.428696Z" 2020-10-05T12:10:24.892 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:24.892 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:24.893 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:10:24.893 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:02:44.564209Z" 2020-10-05T12:10:24.893 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:24.893 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:24.893 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000003835", 2020-10-05T12:10:24.893 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:10:19.428759Z" 2020-10-05T12:10:24.893 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:24.893 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:10:24.894 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone3 2020-10-05T12:10:24.895 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone3', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:24.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone3', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:24.896 INFO:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone3 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:24.938 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:24.939 INFO:teuthology.orchestra.run.smithi081.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:25.189 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2020-10-05T12:10:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_status": { 2020-10-05T12:10:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: "info": { 2020-10-05T12:10:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "sync", 2020-10-05T12:10:25.190 INFO:teuthology.orchestra.run.smithi081.stdout: "num_shards": 4, 2020-10-05T12:10:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: "instance_id": 14774154849435705122 2020-10-05T12:10:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: "markers": [ 2020-10-05T12:10:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 0, 2020-10-05T12:10:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:25.191 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:10:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000005167", 2020-10-05T12:10:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:03:41.181933Z" 2020-10-05T12:10:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:25.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 1, 2020-10-05T12:10:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:10:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:25.193 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:07:50.428696Z" 2020-10-05T12:10:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 2, 2020-10-05T12:10:25.194 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:10:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:10:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:02:44.564209Z" 2020-10-05T12:10:25.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2020-10-05T12:10:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: "key": 3, 2020-10-05T12:10:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: "val": { 2020-10-05T12:10:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "incremental-sync", 2020-10-05T12:10:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: "marker": "00000000000000000000:00000000000000003835", 2020-10-05T12:10:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: "next_step_marker": "", 2020-10-05T12:10:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: "total_entries": 0, 2020-10-05T12:10:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: "pos": 0, 2020-10-05T12:10:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: "timestamp": "2020-10-05T12:10:19.428759Z" 2020-10-05T12:10:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2020-10-05T12:10:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2020-10-05T12:10:25.197 INFO:teuthology.orchestra.run.smithi081.stdout: "full_sync": { 2020-10-05T12:10:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: "total": 0, 2020-10-05T12:10:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: "complete": 0 2020-10-05T12:10:25.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2020-10-05T12:10:25.198 INFO:teuthology.orchestra.run.smithi081.stdout:} 2020-10-05T12:10:25.199 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone3 2020-10-05T12:10:25.200 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:25.200 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2020-10-05T12:10:25.200 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2020-10-05T12:10:25.236 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:25.236 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T12:10:25.472 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2020-10-05T12:10:25.473 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:25.473 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000005300", 2020-10-05T12:10:25.473 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:03:19.033064Z" 2020-10-05T12:10:25.473 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:25.473 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:25.474 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000000780", 2020-10-05T12:10:25.474 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:07:50.555583Z" 2020-10-05T12:10:25.474 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:25.474 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:25.474 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000002374", 2020-10-05T12:10:25.474 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:02:44.575161Z" 2020-10-05T12:10:25.474 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2020-10-05T12:10:25.475 INFO:teuthology.orchestra.run.smithi158.stdout: { 2020-10-05T12:10:25.475 INFO:teuthology.orchestra.run.smithi158.stdout: "marker": "00000000000000000000:00000000000000003835", 2020-10-05T12:10:25.475 INFO:teuthology.orchestra.run.smithi158.stdout: "last_update": "2020-10-05T12:10:20.362392Z" 2020-10-05T12:10:25.475 INFO:teuthology.orchestra.run.smithi158.stdout: } 2020-10-05T12:10:25.475 INFO:teuthology.orchestra.run.smithi158.stdout:] 2020-10-05T12:10:25.476 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:10:25.478 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2020-10-05T12:10:25.478 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2020-10-05T12:10:25.556 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setuser ceph since I am not root 2020-10-05T12:10:25.557 INFO:teuthology.orchestra.run.smithi158.stderr:ignoring --setgroup ceph since I am not root 2020-10-05T23:42:57.115 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-10-05T23:42:57.182 DEBUG:teuthology.task.console_log:Killing console logger for smithi158 2020-10-05T23:42:57.183 DEBUG:teuthology.task.console_log:Killing console logger for smithi081 2020-10-05T23:42:57.183 DEBUG:teuthology.task.console_log:Killing console logger for smithi158 2020-10-05T23:42:57.183 DEBUG:teuthology.task.console_log:Killing console logger for smithi081 2020-10-05T23:42:57.184 DEBUG:teuthology.exit:Finished running handlers